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ABSTRACT • 

This .document reports on* the comprehensive evaluation 

.•of the Georgia Life Skills for Mental Health program,' a primary 
prevention program designed to provide students with. the optcrtunity- 
for learning hasic intrapersonal and interpersonal skills tc handle 
stress, respond to major life decisions, .and form more satisfying 
interpersonal relations without recourse to drugs and alcohol, A 

.description of the program discusses the Activity Guides for 
elementary and secondary school students, the teacher inservice 
workshops, and t*he program implementation, efforts by a network of 
community mental health training teams. Both process and outcome 

, evaluations conducted oyer three years* of the 'prograffi' are described. 
The evaluation, design and procedures are discussed . for the process 
evaluation, the student outcome evaluation, and the teacher outcome 
evaluation,__A_j^p±«x_jOJL_4ir^^ .fodeses on the 

coordinating committee, activity guides, training of local trainers, 
and training of teachers. Results of the student outcome evaluation 
organized by age group- and results cf the teacher autccee evaluation 
are presented and discussed. Final conclusions of the evaluation are 
related to implications for the continued development cf the Life 

. Skills program. The appendices .contain process evaluation materials 
along with student "and- teacher outcome measures. (NBE) h s . 
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/ EXECUTIVE SUMMARY ^ 

i 

^ ^ ^Purpose t 

The study described in this^ docu ment concerns a. comprehensive evaiu- 

ation of the Georgia Life Skills fc?r Mental Health program, a primary pre- 

i 

vention program developed by the Prevention Unit witfiin the Division of 
Mental Health and^Iental Retardation, Georgia Department of Human Resources. 
In its operations, this program enlisted the support* of the Georgia State 
Department of Education, local school districts, and community mental health 
centers. Research for Better Schools conducted a three year evaluation of 

the program, beginning in March 1978 and continuing through February lj981, - 

* * 
to assess the process by which the Georgia Life Skills program was .imple- 
mented and the outcomes of the program for its participants. • v 

/ \ 
Program Description 

The educational prevention program, Life Skills for' Mental Health, . 

was designed to provide students the opportunity for learning basis intra- * 

personal and interpersonal skills which help in handling stress, respond- ~ 

ing to major life decisions, and forming more satisfying interpersonal 

relations. As a result, program participants were expected to be.better^ 

prepared to take responsibility for their lives ^Lthout recourse to drugs 

•and, alcohol. ^ 
* - ' * * *• 

The Life Skills program helps teachers introduce classroom activities 



that deal with self-awareness, feelings, and relationships with others. 

J 
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The program -includes a series of Activity Guidels for* ages 5-8, 9-11, 

v ' . 

12-14, and 15-18 years as well as inservice workshops to prepare teachers 

:to use the Life Skills activities in their classrooms. It introduces 

teachers ^to four strategies they can use with the Life Skills activities 

. * and throughout the school day. These strategies are: Listening for 

• ■» 

Feeling, Behavior feedback, Values Clarification, and Role Playing. 
* *• 

Th§ Life Skills program is implemented through a netwo.rk of community 
mental health training teams that* has been set up across the state. This 4 
. network is coordinated by the Georgia Department of Human Resources. 
% The Georgia Department of Education, which participated in the develop- 
ment of the program, has approved, the Life Skills Training for J^eacher , 
certification renewal credit. As part of the program implementation, a 
- V-^tate ^training team was established. The state team trains the local. 

teams which are coordinated by the mental health centers and often include 
staff from*]b^al education agencies and other relevant community programs. 
These teams then return to their local areas and organize ^workshops for . 
training teachers in the use. and implementation of the Life Skills program 
in the classroom. 



^ Evalu^ion Design 

Both process and outcome effects were addressed in the evaluation 
design. The major part of the process evaluation was conducted* during 
the first year of the study to provide feedback on program development 
Nind to monitor program' implementation. In the second year of the study, ' 
the- process evaluation continued and the pilot phase of the outcome eval- 
uation was begun. The full scale outcome evaluation of students and 
teachers was conducted during the third - year of the study.' 



' 0- 

The process evaluation component of the K^feTskills 'study was 
designed to accomplish the following: -to describe and assess the imple- 
mentation of the Life Skills program plan, to provide ongoing feedback to 
program staff as the basis for conceptual~and operational programmatic 
changes, and to t establish a context for "interpretation of the outcome 
evaluation. In- order, to achieve these ends, the following process evalu- 
ation activities Wiere undertaken: (1) a retrospective evaluation and 
documentation of the work of the coordinating' committee, responsible for. 
the Original design* of the program; (2) evaluation of ~the Life Skills 
Activity ^Guides; (3) evaluation of the Training of Trainers workshop; 
and (4) evaluation of the Training of . Teachers* workshop . Data^collection 

* S. f 

procedures included examination of materials, observations, interviews, 
and survey administration. Descriptive summaries were prepared to doGu- 
ment all activities related to the planning and implementation of the 
program. . . ', * * 

The l^tudent^ outcome . evaluation Was conducted using a repeated meas- 
ures comparison group design. Life Skills and control students in the 
third, fifth, eighth, and eleventh grades were administered a series of 
carefully designed sur veys to meas ure the dependent variable s of s elf 



concept, interpersonal Skills, classroom climate, attitudes toward school, 
attitudes toward drug use, and actual use of drugs and alcohol. The in- 
dependent variables in^sjie study were treatment group, sex^ and ethnicity. 
Student dataV'ere collected on a pre/post/post schedule, in Fall 1979, 

■J v - '• ' 

Spring 1^8Q, aria Winter 1980. Classroom observations also were conducted 



jto gather data on student affective behaviors ; these observations 'were 
conducted on a pre/pbst schedule. 

The teacher outcope evaluation was conducted »on a pre/post schedule 
and was designed to measure four dependent variables: attitudes toward 
mental health, frequency \of use of the Life Skills program, perceived 
benefits of the Life Skills program,^ -and teacher affective -behaviors , 
Data were collected through teacher surveys and classroom observations. 

' . \ ' 

The sample was composed of thfc* teachers for all Life Skills and control 
classes^ participating in the student outcome evaluation. 

' Findings 

Major findings of the process and outcome evaluations are summarized 
below- 



Process Findings 



* - The Activity Guides were found to be successful teaching 

instruments which motivated teachers to try the Life 
' Skills activities in their classrooms. 

# The Training of Trainers workshop was rated highly 
by participants on attainment of objectives r meeting 
participant expectations, and providing opportunities 
for involvement and participation.- 

• The Training of Teachers workshop was rated highly by 
participants on attainment of objectives and on . 
motivating participating teachers to ^employ the Life 
Skills activities and strategies in their classrooms. * 

• /The multi-level training and implementation system used to 
organize and administer the Life Skills program was found 

, to be successful in accomplishing , its objectives and in 
• establishing good working relationships among the various 
agencies inVolved. , 
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• A monitoring vehicle and follow-up technical assistance 
were found to be nd^ded in order to strengthen the imple- 
mentation system of the Life Skills program. ^ 



Outcome Findings 

c 

• Evidence was found supporting the ^impact of the Life 
Skills program in reducing disruptive behavioj and in- 
creasing positive teacher and student affective behaviors. 

• Minimal evidence of support for effects of the Life Skills * 
program in increasing student self concept, interpersonal 
skills,, classroom climate, or attitudes toward school was 
found in thi^ study. 

• No evidence of support for effects of the Life Skills pro- 
gram in reducing drug or alcohol use Was found in rtiis 
study. 

• Previous findings on frequency .of drug use and in differ- ■ * 
ences between the\sexes on drug attitudes and drug use 

were replicated. . . 

In reviewing the findings outlined abcTve^ certain cautions should 
be noted. While the overall study was conducted over* a three year period, 
the outcome component of the evaluation was in operation for only one 
and one-half years. One must be somewhat sensitive tcTthe concern of 
whether this brief period of time is sufficient to adequately- assess 

\ 

the effects of an affectively-oriented program such ^s the Lift Skills 

program, which acts on many of the outcomes measures indirectly! through 

intervening variables. Many of thte outcomes measured may be long-term 
** • • 

effects whi<:h will show increased impact only when students 1 cumulative 
exposure to the Life Skills program reaches, a higher JLevel. ~ 
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* - > ' I, INTRODUCTION * % 

This report describes the implementation and results of the Georgia 
Life Skills^ for Mental Hfealth program, a primary prevention program for 
alcohol and drug abuse developed by the Prevention Unit withfn the Divi- 
sion of Mental Health/Mental Retardation, Georgia, Department of Human 
Resources (DHR). T Under a grant from the National Institute on Drug Abuse 
(NIDA), Research f or , Better Schools (RBS) conducted a three year compre- 
hensive evaluation study of this program beginning in March 1978 and 
contijyiing through Febijrf&ry 1981. The results of this evaluation are. 
fully described in this report. 



Program Description j 
The Prevention Unit of the Division "of* Mental Hfeal'th/Mental Retar- 

" yiatioh developed tire Life Skills for Mental Health program as a col'labor-^ 
ative effort -between the Division of Mental Health/Mental Retardajtion, 

- * thfe Stated Department of Education, and community mental health punters 
The Prevention Unit coordinated' the development of the program with 
broadly based input from educators, community 'mental h ealth staff, other 
mental health workers, and representatives. of professional organizations. 

. The program began on a pilot basis in the- Fall of 1977; By Winter 1980, 
more than three-fourths of the spate's community mental health centers 

• were offering Life Skills to schools and othe f r groups in their, servicfe 
areas. » 

Life Skills is a^enttfl heaUh education program designed primarily 
for regular classroom teachers, regardless of' the. grade level or subject 
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area they tteach. It is '-easily adapted for otlfer aQult leaders who work 
with young people, such as Sunday school teachers or scout leaders.' The 
"^program introduces teachers to r simple ways that they can help their stu- 
dents learn important skills in dealing with the problems and challenges • 

of living, changing, and 'growing up in an increasingly complex world. For 

- *S 

example, children learn to identify their feelings and express them in a 
productive way, to clarify personal values, and to examine* the consequences 
of theiV choices. They learn abeu^stress and ways to handle it, y how to 

negotiate rather -than fight when conflicts arise, and how communication 

** 

styles can build or destroy relationships with significant people in their . 

' <* 
lives. And they learn to anticipate situations they may face in growing/ 

V > > 

■ ** * » 

up and how they can handle them,/ In thfe view of %he program, people who, 

understand their day-to-da? emotions and deal with them honestly will 

better be able to cop6 with serious stress/ 

Program Content 

The Life Skills program helps teachers structure classroom activities 
that deal with ^elf awareness aflft acceptance, feelings, 'and relationships 
with others. The program includes a series of four activity guides and 
an in£ervice training workshop to prepare teachers to use the activities 
in their classroom. • , 

• Activity Guides . • 'Qie- four activity guides have similar formats', -but. 

each is geared to a specific age range: ^5-8 years,. 9 7 11 years, 12-14 

* * • 
years, br 15-18 years, the guides are organized 'into three sectionw which 

correspond to the three major Life Skills program objectives. 

* " • 

' • 1-2 
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Goal T: 



To help young 'people become more accepting of themselves and * 
the significant people with whom they come in contact. 

r 

• To feel better about self as an individual with 'talents 
and personal qualities that are valuable. 



Goal 



II: 



s 



To be less critical of personal limitations. 

• To accept personal characteristics which cannot be- 
changed. 

• To appreciate others 1 talents and accept their* limita- 
tions . • 

• To be able to clarify important value issues/ especially 
in the face of conflicting messages. $P 

• To accept the decisions that others make and the values 
that others hold as being legitimate for them-* 

• be able to generalize learning that occurs in 
specific situations to similar situations. 

To help young people be .more accepting of all feelings. v# 

• To identity feelings. 

• To accept all feelings as legitimate. 

> 

• To claim feelings rather than camouflage thSem 



Goal III; 



• To recognize personal responsibility in choosing how 
m to act on a feeling. r 

v c 

To help young people form more satisfying personal relation- 
ship's with 'significant others. 

• To express feelings and needs verbally to others and 

to feel less scared and anxious' in doing so. 

» *>. 

* <■ 

• To accept the feelings and "needs of others as impor- 

\ tant vto them. < 

, » 

• ( To negotiate productively .where a conflict o^needs 
exists. 



1-3 
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The Life Skills, activity guides provide 'exercises designed to 

strengthen student skills in each of the thr£e goal -areas. Many of the 

activities used in t!he guides" have been adapted from other resources and 

1 " 
were^previously refined for use in other prevention programs. All acti- 

i * \ • 

vities are keyed to use at the appropriate age levels. 



It is recommended thstt teachers use the Life ^Skills activities in , 
I ^ 
one of three ways. First, teachers can set aside a regular part of the 

school day specifically for Life Skills activities, thus establishing. 

Life Skills activities as a special part of the classroom curriculum. 

Second,- Life Skills activities can be introduced at "teachable moments" 

or naturally occurring opportunities during the school day when specific 

Life Skills activities may be used to resolve .issues raided in the course 

of classroom events. Finally^Life Skills activities can be taught in 

conjunction *with regular subject areas, so that learning academic skills 
< ' r • 

and learning about self , ^decisions, feelings, values, and so on become 

integral parts of the student ^s learning experiences throughout the 

school day. 

The Life'Skills activity guides are meant to be means, not ends. 
Teaches are encouraged to us,e othef resources and their own ideas to 
create activities which build on what is in the guides or to raise issues 
jiot covered by the guides\ Teachers may decide not to use, every Life 
Skills activity; rather, they may choose specific' activities appropriate 
to their students and to their letfel of comfort in dealing with the 
issues being discussed. 



f 



Training Workshop , Training is an integral part of the Life Skills 

for Mental Health program and is required for anyone wh6 wants to* use the 

* " f ( 

material- The training program orients participants to the ^prog^am — what 

it is what it is not, acquaints them with the activity guides, and" 

shows them how to use the material in the classroom. Teachers learn foui> 

strategies they can use with Life Skills activities and throughout the 

school day. 

• Active lisWning/listening for feeling helps the teacher to 
reflect the content or feeling that is communicated in a 

v student's statement in order to aid the student in clarify- 
, ing what ±s being said, and' to show the student that he or 

* she has been heard without his or her' opinion or feelings 
having been judged "right" or "wrong." 

•» 

• Behavior feedback is a way of pinpointing the* student's be- * 
havior and the effect of that behavior without judging, 
blaming,- or name calling. t / 

• Values clarification is a process for helping students de- 
cide what is ^nportant to thlfii and just how strong their 



convictions 



• Role playing , as it is taught in the Life Skills program, 
shows the fc^agher spme simple "building blocks" which can 
be Used in the classroom to set a climate where role play 
can be used effectively. 1 " * 

n * 

The training workshop requires a minimum of 12 hours, plus some time 

for follow-up once participants frave had a chance to use the program. 

I 

Through cooperation with the State, Department of Education, teachers can 
earn two units of certification renewal credit. In this case, teachers 
participate in 20 hours of training. \ * 



1-5 
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Collaboration between the local community mental health centers 
(CMHC) and the local school systems includes some of the following arrange- 
ments for teachers participating in the training. " 

• CMHC staff are available on request to meet with teachers, 
principal, and parents to orient them to the program and 

• to answer questions and concerns. • 

_ £ Xf ac ^ er tracing and follow-up technical assistance to 'the * 

^school requesting £he program ^Sjpvided by the CMHC. 

#. Schools may psoVide release time <f or teachers. * 

• Training for the Life Skills program may be written into local 
v staff development plansV This allows school* systems to 

* use straff development funds to* contract with CMHCs for _ 
trailing services. 

Community Mental Health Center Training Teams * The material in the 
Life Skills for, Mental Health program iror the most part is not new. What - 
is innovative is the*way it has been put together and the training net- 
work that has been set up across the s£ate. The community mental health 
center is the^active agfent in making the community aware of the 

i 

program and in providing the* training and follow up t<Kinterested schools 
or otfcer groups t . When the CMHC decides to offer the program, a training, 
team is selected, usually composed of four members, although some teams 
. are larger for CMHCs, that cover a, number 'of counties. The team crfof- 

dinator must be a CMHC staff person, but^ other members of the team may be 
^appropriate school system personnel, volunteers, or staff from other 

community agencies. Often^the team membership h^lps to build or strengthen 
bridges among groups in the area. - 

The local training teams participate in an intensive Training of 
Trainers workshop conducted by the state offidfe of the Division of Mental' 
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ftealth and Rental Retardation. Teams come together again for a follow- 
up workshop several months later, when they have had a chance to stimulate 
community interest and perhaps to try their first workshop. 

The state office furnishes -each team with , a suppiy of brochures and ^ 
a slide/sound "presentation which describe the program, and a suppl^^^^" 
the activity guides.for teachers. In short, £he state office sets^the 
team up, and from then on it is a local program with continuing assis- 
tance from the state office as needed. Also K the Division of Mental 
Health and Mental Retardation serves as, an ongoing. link among teams. 

Having ^he training available at the local level has a number of 
distinct advantages., the lsast of which is convenience to both trainees 

and participants/ With local teams, follow up is much* easier. But per- 

r 

haps the most important advantage is the link between the community meirt a 1 

I 4 — 

health center and the school. In spme areas, the Life Skills program 1 

has. opened doors. As tile trainers become N known in the schools, it is 

much easier to go irtto the school to work with teachers whose students 

are clients at the center. Also, teachers who become aware of special 

problems with individual students are more likely to see the CMHC as "a 

resource. A number of teams We commented" that the Life Skills program 

has helped the GMHC gain more .^visibility in the community a^staf fSfcr.av- 

eled the PTA, civic club, faculty meefe^ng^ircuit with their slide/sound 

presentation. The community be^an to see the center as something other 

than simply a place for people ^with "problems/ 
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I II. EVALUATION DESIGN AND PROCEDURES 

• * 

The evaluatior^of .the Life Skills 'program has been a three year, 
sequenced effort designed to assess the development, implementation, and 
effectiveness of the program. To accomplish this assessment, a coraprehen- 
sive process and outcome evaluation was designed and undertaken. This 
chapter describes the objectives, design, and procedures associated with 
both process and outcome components* of the overall evaluation study. 

„ s " Objectives 

The evaluation study focused on two principal objectives with regard 

to^the Life Skills program. These objectives are listed below, followed by 

\ 

a more detailed description of the rationale for each . 

Objective 1 : To perform an intensive and rigorous process 

, Evaluation of the Life Skills program that would: 

Describe and assess the implementation of the 
Life Skills program plan. „ 

• — Provide ongoing feedback' to program staff as 
the basis for conceptual and operational pro-^ 
grammatical changes'. 



• establish a context for interpretation of tfte^ v 
* outcome evaluation. * 

v Objective 2 : To perform an intensive and rigorous outcome 

evaluation of- the Life Skills program that would: ■ 

t 

• Assess the effectiveness of the program for 
participating teachers- 

• Assess the effects of the program on partici- 
pating stud£»<s. 

•) V 

The process evaluation was ; addressed to the description and assess- 

ment of program implementation, while the outcome evaluation was designed 

to determine what impact the program had on its participants. The major. 
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part of the process evaluation was conducted during the first year of the 

study, to provide feedback on program development and to monitor program 
• * 

implementation. In the second year, the process evaluation was continued 
and, after the program had achieved some stability in implementation, 
, the pilot phase of the outcomg^evaluation w&s begun. The full scale 
outcome evaluation was conducted Airing* the third year of the study. 
Further details on the designs of the process and outcome ev^luafions 
are presented in the following sections. 

Process Evaluation 
Implementation of the Life Skills ^or Mental Health program involved 
a multi-stage training process culminating in use of the materials and 
strategies in. the classrpom. Inherent in this implementation process is 
the belief that the Life Skills program represents an approach to primary 
prevention which has significant potential and which merits close evalua- 
tive scrutiny. By utilizing community mental health agencies as the link 
between program sponsors and. the public schools, the Georgia Department of 
Human Resources had developed a new program dissemination strategy which 
seemed to warrant rigorous testing and careful refinement. As such, RBS 
was retained^to study the -Life Skills program as a .prototype which could 
hold great. import for the prevention field. ' 

Originally a coordinating committee was* established between the ' - 
Georgia Department of Human Resources and the Georgia Department of Educa- 
tion for the purpose of overseeing the development, production, and pilot 
testirig of the , Life Skills for Mental Health strategies and mateftafe^ 
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As part of the program implementation, a state training team was estab- 
lished for the purpose of passing on knowleage about use of the activities 
and strategies of the program to a group\f trainers organized in the 
form of teams representing local ^education agencies and local community- 
mental health centers. These trainers and training teams were then to re- 
turn to their local areas and to organize workshops for training teachers 
in the use and implementation of the program in the classrooms (see Figure 
2-1). Thus, in a process sense, the work of the Coordinating Committee 
was key in development of the program materials; the program materials 
themselves are key in providing a vehicle for program activities; the 
Training of Trainers and Training of Teachers workshops are key in trans- 
mitting' knowledge about program materials and implementation; and the ^ 
actual classroom implementation of the program by teachers is key to 
setting the stage for any potential program impact on either students or 

teachers . 

v y 

The process evaluation component of the Life Skills study was de- 

signed to accomplish the following: to describe and assess the implement 

tation of the Life Skills program plan, to provide ongoing feedback to ^ 

* • 
program Staff as the basis for conceptual and operational programmatic 

changes, and to establish a context for interpretation of the outcome 
evaluation. In order to achieve these ends, the following process evalua- 
tion activities. were undertaken: (1) a retrospective evaluation and 
documentation of the work of the Coordinating Committee, responsible for 
the, original design of the program; (2) evaluation of the Life Skills 

'< r 

* — 

activities guides; (3) evaluation of the Training of Trainers workshop; 
and (4) evaluation of the Training of Teachers workshop. 
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Figure 2-l< Life Skills Program Implementation 
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Coordinating Committee ♦ 

The purpose of evaluating the^work of the Coordinating Committee 
&s threefold: , 

• To document, through the use > of files and selected interviews, 
the development of the Life Skills program from its inception 
in the Winter of 1976 to June 30-, 1978. 

• To offer sets of objectives and desired outcomes which would 
♦ be useful in establishing' evaluative criteria and developing 

instrumentation. <- ' ' 



• To provide a context for iater interpretation of process and 
outcome evaluative findings. 

% 

At the time this evaluation study was funded, active involvement of 
the Coordinating Committee in the^operation of the Life Skills prografh had 
ceased. Thus, the establishment of objectives and*miles"tones for the 
committee's work and the evaluation of that work had to accomplished 
retrospectively. This was done by means of reconstructing the history 
and past activities of the committee from documents already collected 
and from information gained in interviews with committee 'members . 
The results of this york r are summarized in Chapter III of this report and 
• ar<e detailed separately in a document entitlefr/ A Developmental History 
of the Ge orgia Life Skills for Mental Health Program (Strandmark & 
Dusewicz, 19/8) * * 

Two structured interview schedules were developed and used in inter- 
viewing Coordinating committee members and pilot training team leaders. 
The purpose of the first interview schedule was to gain^ommittee members' 
perspectives pn the 6riginal. goals and objectives of the committee, ta > 
document its working procedures, and to have the' members reflect upon the 
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past development of tta^Life Skills program and* the problems, issues, 
successes, and failures otie could expect to encounter in the future. The 
purpose of ^he pilot training team leader .interview schedule was to\n- 
- cover and document ther experiences % (successes and failures) of trainers 
who had had a year's involvement in both diffusion of the Life Skills 
program and in presenting teacher training workshops^ wittfin the 

[ewa and this documentation 



school districts. Results from thes^in terete 
effort were intended to be conveyed to the Life Skills program staff for 



analysis and planning purposes. 

In conjunction with the process evaluation, an effort was made to 
gather all available information and records relating to the history and 
development, of the Life Skills program, s*o that a comprehensive documen- 
tation if it could be compiled. Iftre. documentation cotfld then be used - 
both as a source of background information on the program for the ev^Lua- 
tion team, and as a perspective .from which future-, evaluation efforts and 
program development couid be viewed. 

Activity Guides 

v 

In order to evaluate the. Life Skills Materials as a com{ffment of the 
program, ^ consumer evaluation panel was* cSnVerted to critically ass^s^ 
the Life Skillfe activity guides*. ^Elaborate planning and participant 
selection procedures were undertaken in association with the Life Skills 
evaluation panel. The purpose of the panel was to bring together con- 
sumers of the Life Skills program for" the purpose of evaluating various 
aspects' of the program with respect to effectiveness, efficiency, and 



:RLC 



.11-6 



utility. It'was hoped ttlat, through such a meeting, a better understanding 
of the problems and 'difficulties in areas of application of the Life 
Skills program coul^d be secured. In keeping with these aims, every 
effort was made to gain wide geographical representation while, at the 
same time, providing for representation of teachers in each of *the four 

X 

Life Skills activity guide age "groups. The panel met with evaluation 

% 

staff for a full day , and completed an extensive packet of evaluation in- 
struments. The basic concerns assessed by these instruments were: educa-~~ 
tional value, comrilinicability^ motivational value, utility, and format. 
A full report on the results of, the consumer evaluation^panel is included 
in a separate document entitled, The Life Skills fojr Mental Health Con- 
sumer Evaluation Panel Report (Swisher, Martinson, & Dusewicz, 1978). 



Training of Trainers / 

Specific objectives were established . for the Training of Trainers 
workshop an/ these served as the basis for the evaluation of this aspect 
of the program. The Training of Trainers workshop objectives were essen- 
tially those stated in the training manual and derived from previous 
training information. Some modifications to these objectives were made, 
but these were undertaken by the Life Skills program staff, not the 
evaluation team. Thus, the evaluation team played no role in originating 
^objectives, but rather acted as a catalyst in prompting their formulation 
k in) revised form so that they could be evaluated. These objectives were * 
as follows: * 1 \^ 
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• To create an awareness of the importance of affective educa- 
tion. 

A 

a 

• To increase understanding, of the relationship bet.we^h affec- 
tive and cognitive learning, , 

• To create an understanding of the rationale for promoting 
^positive affective and' cognitive growth as a prevention 

strategy in mental health. 

• ^ To introduce and demonstrate selected classroom -activities in" 

the Life Skills program. 

• To facilitate teachers '/trainers 1 personal knowledge -and skill 
in the four Life* Skills strategies. 

^ • To develop and/or .increase trainers confidence in their ^ 

ability to conduct Life Skills teacher training workshops 
, and teachers * oonfidence in their ability to co/iduct Life 
Skills, activities. 

*. 

• To provide resources for additional training, consultation, 
and materials. 

The same objectives were utilized for the Training of Teachers 
workshop. Two different measures were used to assess the effectiveness 
of the Training of Trainers workshop one revised from a previous measure 

one ^ ewly developed. The former was a questionnaire designed to be 
administered at the end of each woVksHbp (see Appendix This was 

based on revisions in content, format, and scaling of a similar measure 
used during the preceding year by the program staff. The latter, instru- 
ment, an attitude assessment measure, was conceived of and constructed 
as an entirely original measure (see Appendix A) . 

The attitude instrument was created in response to the belief that 
it is Qecessaly in any workshop w itfT subs tan t iXr^fTe^i v^ con t^en t^ ^o ~ 
gain some knowledge of the effect of the workshop on its participants 1 
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attitudes. The attitude measure was sensitive to changes in attitudes 
on variables relevant to the concepts stressed by the workshop content, 



ay 



including receptivity to the notion land utility at. the four Life Skills 

strategies and to the concept of affective integration as defined By the* 

J ' ' 

^training manuals. In order to obtain such a change measure, both pre and 

posttesting were required. Pretestil^^tas conducted er the, guise of at\ 
instrument serving as arNadvance organizer for wprkshop activities (a task 
task which it^lso accomplished). * " 

In addition to thefee measurement Instruments, general observations 
were recorded about Training of Trainers workshop activities, and work- 
shop participants *;ere interviewed informally. Follow-up Training of - 
Trainers workshops were evaluated in a' similar manner. 

Training of Teachers 

The objectives outlined above for the Training of Trainers work- 
shop were also utilized for the twining of Teachers workshop. A special 
questionnaire, representing a revision of a previous- instrument in con- 
tent, format, and scaling, was used as one of two instruments in evalu- 
atii}g the Training of Teachers workshop (see Appendix A) . This was 
administered on a postfest only basis. The second instrument, \an atti- 
tude assessment meagre, was administered on a pretest/posttest basis and 
was us£d to determine attitudirial* change in areas believed to be related 
to the strategies^and-materials stressed in theworkshop (see Appendix A) . 
As with the Training of Trainers workshop, this Jitter instrument was ad- ' 
ministered in the guise of an advance organizer for workshop activities. 
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Data Collected on these instruments , as with the Training of * Trainers 
workshop, were supplemented with observation^ informationgaild iri4ividual 
interviews with participants. ' ' I 

Another concern- of the pracess evaluation, related to tjte training 

• • * 

SI 

of teachers, .was the extent of use of the Life" Skills activities in the 
classroom by teachers who Were trained through, the Training* of . Tea'fcheps 

N 

workshops. This involved the~ question of transfer of training, An^acti- 
vlty log was constructed in order to provide information on the follow- • 
ing variables i^-the degree to which Life Skills activities were used in 
x the clas'srox^m, how the Life SkiAs activities were "used -In the classroom, 



and the frequency and duration with which Life Skills strategies were em- 
ployed (see Appendix C) . - * * 

. Outcome Evaluation v ^ 

The outcome evaluation was designed to determine what impact the 
Life Skills program h'ad on its- participants, Student outcomes and teacher 
outcomes were the two major areas of interest. 'f * ^ 

Stticlent Outcomes • *' • 

To address' the objectives identified for students in th.e Life Skills 
program, six primary research questions were formulated. These research 
questions were used to structure *th£ design of the student outcome < ^ * 

evaluation. They are presented in Figure 2-2. ^ 

V : 

f < 
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'Research Questions *• 

s 


Dependent Variables 


Does the LS program have a positive 
effect on intrapersonal skills?* 


Self-concept \ 


Does- the LS program have a positive 
effect on interpersonal skills? 


Interpersonal skills 

c 


Does the LS prbgram have a positive 
effect on classrodm climate? 


Classroom climate 


Does the LS program have a positive 
effect on attitudes toward school? 


School attitudes 


Does the LS program have a positive- 
effect in reducing drug-related be- e 
haviors? 


Frequency of drug use . 
Attitudes toward drugs 


Does thfe LS program have, a positive 
effect on the frequency of disrup- 
tive referrals? 


Disruptive behavior 


* 



Figure 2-2: Research questions for student outcomes 

Research Design ♦ Student outcome da,ta tQ address the research ques- 
tions posed in Figure 2-2 were collected though the use jof survey instru- 
merits and direct 6bservations. A repeated measures comparison group de- 



sign was used as the basis for the research plan. This design is shown 



In Figure 2-3. 



LS Group • ft 
Comparison Group 0 



Figure 2-3: Repeated measures comparison group design 
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This design allowed a compariaon of the Life Skills stydents with a" 
similar group of control students, as well as measuring the effects of the 
program over time. The time factor was f&t tov s be^especially important 
in assessing the impact of the program on long term, drug-related behaviors 

Three independent variables were included ^in the rese<pch-design: 
treatment group, sex, and ethnicity . Contributions of these variables * 
were assessed relative to each of the dependent variables using regres- 
sion analyses. The analyses performed and results obtained using this 
research design will be described in Chapter IV. 

Sampling . Sampling was done in such a manner as to arrive at Life 
Skills and control groups approximating the ag£ range of the four levels 
of .the Activity Gaides used in the program. ,While the Guides are keyed 
to age groups, classes within grade levels approximately corresponding to 
each^age group were used in sample selection, Thus, four age/grade groups 
of students were selected for the sample: 

• Early Elementary (EE) - Grades 3 -and 4 

»* * 
*• Upper Elementary (UE) - Grades 5 and 6 

#. Intermediate (I) - Grades 1 and 8 s - 



• High School (HS) - Grades 10, 11 and 12 



/ 

In each of these age groups, both a Life Skills sample and §7control sam- 
» pie were chosen. These samples were chosen by classroom in order to 

facilitate testing and tracking procedures. 

Criteria for Selection . For the Life Skills sample, participa- 
tion was limited to students whose teachers had received Life Skills 
training. Further, since all participation in the evaluation was volun- 
tary, student inclusion was dependent on, the cooperation of the principal 
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and the teacher. Three primary criteria'were us.ed to construct the pool 
.of potential Life Skills classes: N ^ 

• Valid evidence of teacher's recent Life Skills training, - ~ 
B • • Principal's willingness to cooperate, v 

• Teacher's yillingness to cooperate. ■ 

The procedure for implementing these criteria in selecting Life 

♦ 

Skillg participants began with the £MHCs and followed several steps. 

Step lz Contact all 34 Georgia CMHCs and obtain lists of 
Life Skills teachers trained within one year of 
pretesting. , » 

Step 2: Contact school principals and obtain permission for 
participation in the evaluation study. 

Step 3: Contact teachers and obtain cooperation for parti- 
cipation in the evaluation study. 

^Irei^oi^ng this procedure, approximately J5 percent of the principals 

contacted agreed to participate, and about 80 percent of the teachers 

agreed to cooperate. 

« 

For selection of the comparison classes, several additional factors 
had to be taken into consideration. The nfbst important of these was 
locating a sample of control classes which would be comparable to the 
Life Skills classes. The procedure used to identify and obtain the coop- 
eration of these control classes is outlined below. 

Step 1: Ask principals in schools from which Life Skills* 
classes have been selected to identify comparable 
non-Life Skills classes in the same school. 

Step 2: Obtain permission from the teachers of these com- 
v parable classes to participate in the evaluation 

. study. 

Step 3: When the number of comparable, control classes avail- 
able iji the Life Skills schools is insufficient, ask'* 
principals to identify similar non-Life Skills schools 
from which control classes could be selected. 
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Step 4: Contact principals in non-Life Skills, schools identi- 
fied in Step 3, check on comparability, and obtain 
permission for participation in the evaluation study. 

Step 5: Obtain cooperation from control teachers in these 

schools for participation in the Life Skills evalua- 
tion study. 

" *v ■ 

To implement these selection procedures for the control groups six 
primary criteria were used to determine the comparability of control 
classes and Life Skillfc^elasses: 

• Grade level 

• Ethnic balance* 

• Male/female balance 
Ability; level 

• Teaching style — 

• Geographic location 

o 

Following these criteria,- the sample of control classes was determined.— 
The composition of both the control sample and the Life Skills sample is 
described in the* next section. 

% 

Sample Composition . Using the criteria discussed in the pre- 
vious section, the sample? of Life Skills and control students was chosen 
in early Fall '1999. Efforts were made .to include representative segments 
of urban; rural, and subi^rban students from^all parts of Georgia. Schools 
in the Atlanta, Augusta, Macon, Savannah, and Swainsboro area were in- 
eluded in the sample. Table II-l describes the pretest sample. 

In each age group, the target numbers were approximately 600 Life 
Skills students and 200 control students.. The actual pretest sample fell 
short of these target numbers in the intermediate Life Ski^J-S group and 
the high school control group. These shortages were due in part to. a 
lack of cooperation at the secondary levels ." Representation of the sexes 
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Table II-l 

Composition of Pretest Sathple by Age, Sex, and Ethnic Group- 



Level Group • Total Male Female White Nonwhite 



Early LS 
Elementary C 


. 644 
278 


.51 .49 

.55 .45 

ac , 1 


.55 .45 
.44 ' .56 


Upper LS 
Elementary C • 


591 

• 228 


.49 .51 
.46 .54 


.67 .33 
-.55 .45 


N Intermediate 


518 
378 


.48 .52 
.52 .48 


.54 .46 

^-—.57 .43 . 


High ' LS 
School C 


573 
• 127 


.42 .58 
.54 .46 


.62 .38 
' .59 ' .41 










LS 

• TOTAL 

u 


2326- - 


. . _^ ' i 

- .48 _52 


.59 .41 
.54 . .46 


• 1011 


.52 : .48 
■ * 
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\ 1 \ 

in the pretest sample was approximately equal; a slightly higher percentage 
of whites than nonwhites participated in the .pretest sample. 

Table II-2 and Table II- 3 present t;he composition of the samples for 
posttest I and posttest II. Both 1 the Life Skills sample and the control- 
sample declined somewhat $t each testing, but. the relative representa- 
tion of males and females and ethnic groups remained' approximately the 1 
same as for tKe pretest. In most cases, the declines in student partici- 
^pation were due to principals' or teachers 1 decisions to no longer continue 
involvement in the evaluation. When a principal made this decision, often more 
than 100 students were affected. A single teacher's decision to discon- 
tinue^ vol vement usually resulted in the loss of 30 studen|s or more. ' 
♦ « 

Thus, the .voluntary nature of program involvement and the long duration 

of ,-the* evaluation effort resulted in higher attritioi^ rates than might be V \^ 

desirable. 

For many of the analyses performed in the evaluation, it was neces- 
sary to have complete data on each student for all three test administra- ' 

tions. In order to accomplish this, a matched sample was composed, 
including only those students who had participated in all three test 
administ'rations. Table II-4 shows the composition of this final, matched 
sample. Relative t epresentations of males ,and females and ethnic groups 
in this matched sample remained similar to that for each of the individual , 
test administrations. 

Instrumentation . To measure the dependent variables described 
earlier in this -chapter, an instrumentation search and development 
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Table ,11-2 



Level 



Composition of Sample for Posttest I, By 'Age,/ Sex, and Ethnic Group 
Group Total 



Male 



Female 



White Nonwhite 



Early ~ LS 
. Elementary C 


479 
228 


.53. .47 
.54 .46 

J— 


/ .53 - .47 
.44 .56 


« Upper LS 
Elementary C 


538 
205 


.49 .51 
.47 " ,.53 


.62 .38 
\ 

.57 .43 


LS 

Intermediate 
-A 


439 
349 


.49 ' .51 
.50 .50 « 


t; .56 .44 
.59 ' .41 


High LS 
School -6 


506 

— --- 6a 


.43 .57 , 
■ .53 - ,47 


..60 V .40 
• .61 >.39 


LS 

TOTAL - 

* » 


1962 

842 • ; 


t 49 .51 
.51 .49 


.58 .42 
.55 .45 t 



h 



>" f'" ( 

i / 
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Table II- 3 



Level 



Composition of. Sample for PostteS^ II, By Age, Sex, and Ethnic Group 

; ♦ 

\ 

Group Total Male Female White Nonwhite 



vEarly LS 
Elementary " * C 


305 
. 126 


.53 .47 

AO c i 


.58- * * '42 
.61 \ .39 


TT LS ' 

Upper 

Elementary C 

* 


* 75 N 

- 131 \ 


1 ■ 

.46 .53 

-\ .47 ,53 Jf 


.71 .29 . 
-.59 .41 

s 


V 

LS 

Intermediate t 

C 

> 


238 
. 250 


.47 .53 
.49 .51 


: » — , — 

.54 t .46 
.57 .43 


High LS 
School C 


219 
58 


•37 .63 
. .56 • .45 


.63 .37, " 
.71 .29 


LS 

TOTAL 

C ^ 


1237 
565 


.46 .54 
.49 .51 


.63 . .37 • , 
• 5"9 .41 4 
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Table II-4 



V 

L 



Matched Sample Across Pretest, Posttest'I, and Posttest II 
By Age, Sex, and Ethnic Group 



evel 



Group 



Total 



f Male " Female' 



White 



Wonwhite 



\ LS 
Wly LS 

Elemehtary C 

\ * 


1 7H 
J. / U 

' 102 


• JO m H 1 

.51 .49 


• OZ • JO 

.60 ' .40 

» 


— r— \ s — • 

»i LS 
Upper 

Elementary C 

a , 


310 


.45 .55 
.,42 ' .58" - 

y 


.66 ' * .34 • 
,.62 : .38 : 


- LS 

Intermediate 

u 


178 
185 


.46 .55 . 
.50 .50 


.50 • ; .50 
.56 .44 










High LS 
School C 


120 
37 


.30 .70 
.62 .38 


,.70 . 30 

.61 .39 / 

— * — »? J 


■TOTAL • • LS 
' C 


778 
421 


.44 . .56 

> 

.49 .51 
/ 


.62 .38 
! .59 .41 



9 

ERIC 



35 



procedure was undertaken early in the 'second year of tVe evaluation. The 
search for existing instruments revealed 1 vfery few measures which were 
relevant to the. Life Skills, objectives. Thus/ instrument development 
was begun. The newly developed instruments' were pilot tested in Spring 



1979 and data from the pilot- test were analyzed in Summer 1979.^ On the 
basis of these findings, the instruments werfe revised and reanalyzed. 
Complete descriptions of all these procedures and analyses can be found* 
in the Impacts of a Geo rgia Drug Abuse Prevention Program: , Second Annual 
Evaluation Report (Research for Better Schools, 1980rN-^ 

figure 2-4 provides a summary the research questions, dependent 



& ^ T± *f les > and corr esponding instrumentation for measuring student out- 
comes. Copies of all instruments ar.e included in Appendix B. For mos>t 
, instruments, scale scores were computed by assigning numerical values to 

€ each response^ category, summing the values for all responses, and dividing 
by the number of items completed,, These scale scores* then were used in 
performing ^the analyses. 1 

Validity and reliability information was obtained for each instrument. 

A? - ' • ' 
Table II-5 presents a summary .of these reliability and validity studies. 

The reliability data reported in the summaty tabLj represent^* co- 
efficient alpha computed for the second gosttest.i Previous reliability 
studies were conducted for the pretest artd. first tfpsttest. Over the 

^three tes t periods, the range of coefficients for;>any one instrument aver- 

• • % 

aged only .042 and was never larger than .083. Thus, based on the small A 

variations in the reliability coefficients, a decision was made to use 

the itfost recent testing as the basis for the summary of reliability 
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Research Questions 



Does the LS program have 
a positive effect on 
intrapersonal skills? 



Does the LS program have 
a positive effect on 
interpersonal skills? 



Does the LS program have 
a positive effect on 
classroom climate? 



Does the LS program have 
-a-pusl t±ve~e£ fee t " onT 
attitudes toward schdol? 



Dependent Variable 



, Self concept 



Interpersonal 
relationships 



Classroom climate 



Schools^ttitudes 



Measures Used in Student 
Outcome Evaluation 



Myself .(EE) 
Myself (UE, T, HS) 



My Class (EE) 
School Life (UE, I, HS) 
Life SKtl-ls for Mental 
Health Classroom Obser- 
vation Form (EE, UE, I , 
HS) 



About Your Class (EE) 
About Your Class (UE, I, 
HS) . * 



Attitude Toward,_£chooU 
(UE) 

Attitude Toward Sc hool 
(I) 

Attitude Toward School 
(HS) 



Does the LS program have 
a positive effect on- 
drug-related behaviors? * 



Frequency of^b&ig 

v Attitudes toward 
drug use 



My Opinion (UE) 
My Opinion on Drugs and 
Alcohol (I, HS) 



Does the LS program 'have 
a positive effect on 
frequency of disruptive 
behaviors? 



Disruptive behavior 



Disrup five Behavior 
Scale (EE, UE,, I, HS) 

L 



\ 



r 



Figure 2-4:- Instrumentation Plan for Student OutcofffeB- 
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Table II- 5 

Validity and Reliability Information on the Life Skills 
Student Outcome fc Evaluation Instrumentation 



H 
H 
I 

to 
to 



Resesrch Questions 


Dependent Varisbles 


Measures for Student 
Outcome Study 


Relisbility* 


Tentstive Fsctor 
Structure** 


Does the LS progrsm hsve 
a positive effect on * 

lULtopctoOUal SK1J.J.8 ( 

■ 


Self Concept « 

f 


Myself (EE) f 

Myself (UE) 
Myself (I) 
Myself (HS) 


* 

♦ 


.690 

• 00 / 

.874 
887 

. OP/ 


Inner Directedness (s) 
.^Outer Directedness 

Self in Relstion to Peers (s) 
Self in Relstion to Family 
Self-Ausreness 


Does the LS program hsve 
a positive effect on 
interpersonal skills? 

♦ 


Interpersonal skills 


My Clsss (EE) 

School Life (UE) 
School Life (I) 




.762 

• 

.919 
.903 


Relationship with Tescher (a) 
Relstionship with Clsssmates 

Relationship with Tescher (s) 
Classroom Relstionships Among Peers 
Personal Relstionships Among Peers 






School Life (HS) 




.922 


Single Underlying Factor of Student 
Affect (b) 

• 




I 


Life Skills for Mental Health 


^ ,886 - 




<• 


Cisssroom Observation Form 
(Question 7) ^^0^^^ 


« 


Does the LS program hsve , 
a positive effect on 
cisssroom cliraste? 


Classroom climate 


About Your Class 
About Your Class 


(EE) 
(UE) 


* .798 
.857 


Single Underlying Fsctor of Cisssroom 
.Climate (b) 




4 


About Your^cikas 


<W 


.838 








About Your Class 


(HS) 


.879 
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Table II-5 (cont;) 



Research Questions 



Dependent Variables 



Measures for Student 
Outcome Study 



Reliability* 



Tentative Factor 
Structure*** »' 



Does the LS program have 
a positive effect on 
attitude toward school? 



Attitudes toward 
school 



Attitude Toward School (UE) 



Attitude Toward-Sehool (I-) 



Attitude Toward School (HS) 



.921 



-\- ,912 
.876 



Attitude Toward Learning (c) 
School Climate 

Attitude Toward Learning (c) 
School CKlmate # 

Attitude Toward Learnfrrg (c) 
Attitude Toward School 
Attitude Toward Teacher 



Does the LS progranv have 
* a positive. effect on 
drug-related behaviors? 


p 

Frequency of drug 
use 

a 


My Opinion (UE) 

* Attitudes 
Use 

My Opinion on Drugs and 
Alcohol (I) 




\844 
.799 


Negative Utilities (d) 
Drug Involvement 






Attitudes 
Use 




.906 
.669 


Acceptance of Drug Use ,(d) 
Perceived Utility of Use 




♦ 

« 


My Opinion on Drugs and 
Alcohol (HS) . 

Attitudes 
Use 


\ 


.817 
.695 


u 

Acceptance of Drug Use (d) , , * 
Perceived Utility oFUse ** 



Does- the LS program have 
a positive effect on 
frequency of disruptive 
behaviors? 



Disruptive behavior 



Disruptive Behavior Scale 



Form of this scale not amenable to standard relia- 
bility and validity analyses/ 



♦Coefficient Alpha . ^ 

**Based on factor analyses of appropriate data; (a) principal components with varlmax rotation on pilot data; (b) analysis of item to total correla- 
tions on pilot data; (c) factor analyses conducted for the Pennsylvania Educational Quality Assessment [see Getting Inside the EOA Inventory. 
Pennsylvania Department of Eduction, 1976]; (d) factor analyses conducted for the NAPA Project, Pacific Institute for Research and Evaluation. * 
Lsee Scaling of Student Self-Rehort Instruments . December 1970J. » 
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information.^ Further discussion of the previous reliability studies and 
.documentation of the factor structures reported in the summary table can 
be obtained from the Impacts of a Georgia Drug Abuse Prevention Program *. 
Second Annual Evaluation Report (Research for Better Schools, 1980). 



Procedures . Student data were collected at three points during the 
evaluation study. Pretesting was conducted in Fall 1979, data for the 
first posttest were^gathered in Spring 1980, and a second posttest was 
conducted in Winter 1980. A£ each of these three -testings, all measures 
listed in the instrumentation plan, except the observation form and the 
disruptive behavior measure, were administered to each student. Total ^ 
administration time averaged approximately 40 minutes* The instruments 
were administered by RBS field staff, who rfead standardized instructions 
and followed predesignated testing procedures; At times, a tester may 
have found it necessary to'modify procedures slightly in order to accommo- 
date" conditions in a particular school or a particular teacher's class- 
room. However, the adjustments made in these cases were small. Identical 
procedures were followed in testing the Life Skills classes and the con- 
trol classes. 



After student data were collected in Georgia, the forms were sorted 
and shipped to RBS in Philadelphia for coding, data entry, and analysis. v 
All student names were converted to number codes in order to preserve 
confidentiality. 
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Teacher Outcomes . * # / • 

* • ■* 

In order 'to assess the eff ectiveness'of the Life Skills program for 

participating teachers, both direct observations and survey measures were" 
used to determine teacher outcomes* Four primary research questions were 
formulated regarding teacher outcome^ These questions, and the corre- 
sponding dependent variables 'are showrr in Figure 2-5. 



Do teacher attitudes toward mental 
health'' become more positive after 
participation in the LS program? 


* « 
' Teacher, attitude toward mental 

health 

• « 


Does teacher use of the -LS program 
change during extended program 
participation? * 


^Teacher use of program 


<Do teacher perceived benefits of 
the LS program change during ex- 
tended program use? \ 


Teacher perceptions of> program 
benefits 


Do teacher behaviours related to * « 
classroom climate become-*more posi- 
tive during participation in the 
LS program? 

t — L 


Teacher behaviors 

„ 4 



Figure 2-5: Research Questions for Teacher Outcomes ' 
Research Design, The research design used to assess teacher out- 



comes was a pre-post comparison group desrgn, shown in Figure 2-6. 



LS Teachers 
Control. Teachers 



-J 

Figure 2-6: , Pre-Post Comparison Group Design 
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Teacher outcomes were assessed through the use of direct classroom 

observations ancTsurvey instruments. Since classroom units typically 

remain intact for only one school year, this factor liad to be considered 

in designing the teacher outcome evaluation- Student data were scheduled 

~toJbe~collected-^^ For the Fail 

1979 and Spring 1980 testings, a, high percentage of the students would 

be in the same classrooms, but by the time of the Winter 1980 testing most 
i . 

would' have moved on to new teachers and often to new schools. Since the 
• i » - 

* 

validity of the observation data was dependent on the constancy of the N 
* 

teacher/student classroom unit, it was decided that only two observations 
would be conducted - a pretest observation in Fall 1979 and a posttest 
observation in Spring 1980. Similarly •^nce it was felt that the influx 
of a nrfew class might significantly affect a teacher's use and perceptions 

of the LS program, only two administrations of the teacher survey instru- 

\ 

ments were scheduled— one at the time of student pretesting in*Fall 1979 
and one during the first student posttest in Spring 1980. These condi- * 
tions thus necessitated the use of a gre-post comparison group design. 

Sampling . The teacher sample corresponded to the student classroom 
-sample-. — Th at -is ,—onee-a- class-was chosen to participate in the evalua- 
tion of student outcomes, the^feacher was automatically included in the 
teacher outcome evaluation sample. Thus, the maximum number of teachers 
th4t was available for participation in the teacher outcome study was 
represented by the number of participating classrooms. Thepe numbers 
are shown in Figure 2-^7. 
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Pretest Posttest I 



LS 



Group 



94 
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-Riguse— 2^jL> — Nurobeg-of~ ei assro oms Pa r t t trtp^trltfg 
in Life Skills Evaluation Study 



«\ As explained earlier, all participation was, dependent on voluntary 

m 

cooperation from principals and teachers. When a teacher agreed to par- 
ticipate in, the study, he or she was made aware that the commitment in- 
eluded not only student testing, but also classroom observation and the 
completion of teacher attitude surveys. However, since th4 study was ' 
voluntary, at times teachers chose not to participate in various seg- 
ments of the teacher outcome study. This lack of cooperation naturally 
decreased the^ teacher- outcome sample size on some measures. Specific* 

levels of participation will be included in the discussion of results 

_ t y 

for each measure in Chapter IV. ' * 

Instrumentation . 'To measure. the dependent variables related to 
teacher outcomes, three instruments were used. Figure 2-8 provides a 



summary of j the research questions, dependent variables, and corresponding 

\ ' + . * " 

instrumentation for teacher outcomes. Copies of each of these instruments 

\ 

are included in Appendix C. , " 
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Research Questions 



Do teacher attitudes toward 
mental health become more 
positive after participa- 
tion in the LS program? 



Does teacher use of the LS 
- progranb -ehange-during-ex— 
tended program participat- 
ion? 



Does the teacher \s perceived 
benefits of the LS program 
change'during extended pro- 
gram use? 



Do tea<^ier behaviors re- 
lated totiassroom climate 
become more positive during 
participation in the LS 
program? 



Dependent Variables 



Teacher attitude toward 
mental health 



Teacher use of LS 



program*: 



Teacher T s perception 
of program benefits 



Teacher behaviors 



Measures Used in Teacher 
Outcon# Evaluation 



Life Skills for Mental 
Health Opinion Survey 



Life Skills for Mental 



-H eal-th-$eaeher -Survey - 



Life Skills for Mental 
Health Teacher Survey 



Life Skills for Mental 
Health Classroom Obser- 
vation Form 



Figure 2-8: Instrumentation Plan for Teacher Outcomes 



Development of each of the teacher outcome' instruments followed 
somewhat different paths. The Life Skills for Mental Health Opinion Survey 
wa^originally developed and validated by Life Skills trainers. This sur- 



. vey was usedTTrT^eacher training sessions to assess initial teacher 
, orientation toward mental health concepts. It was adopted for the outcome 
^ evaluation in order to determine if Life Skills teachers exhibited signifi- 

cantly different attitudes toward mental health than the comparison group 
of control teachers which had not been exposed to the Life Skills program. 
Validity information on this instrument is limited to the content validity 
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established by the Life Skills trainers as they reviewed apd refined the 
instrument in various training situations. The internal consistency re-^ 
liability coefficient for the posttest evaluation sample was a = .707. 

_The second instrument used in the teacher outcome evaluation was the/ 
— fctfe^Sktllrgr for^Mel^aTTI^lth Teacher Survey . This survey~was ' "developed"" 
as a part of the outcome evaluation to provide descriptive information -on 
teachers v use of the LS program and teachers/perceptions of the benefits 
of the program. -The content validity .of this instrument' was* established 
by mental health professionals in the Georgia Department of Human Re- 
sources. The alpha reliability coef f icient «f or the scale of perceived, 
benefits (Question 6) computed on data'from the posttest was a = .748. 
The third and final instrument to measure teacher outcomes was the 

4 

Life Skills for M ental Health Classroom Observation Form . This instrument 

* * 
was developed at the same t'infe as the student measures. After an ^xten- 

sive search through existing observation measures, one measure, the 

Alternative Setting Observation Form 1 , was located which corresponded 'to 

many of. the needs for -the Life Skills outcome evaluation. - This instrument 

was adapted 4nd pilot tested in Spring 1979. Detailed results on validity 

analy ses and paired rater responses can be found in Impacts of a Georgia 



Drug Abuse Preventi on Program: Second Annual Evaluation Report (Research 
for Better Scfiools, 1980). The internal consistency reliability coefficient 



r ' 

^uttram, Joan L. Alternative Setting. Observation Form . Research" 
for Better Schools, Inc., Philadelphia, Pa. ,.1979. 



? • • ^ 
11-29 



• * m 

for the observation scale on teacher behaviors (Question 6)* computed for * 
the posttest was a = .898. * 

Procedures . Teacher outcome data were collected in Fall 1979 and * 

Spring 1980. The Life Skills for kental Health Opinion Survey and the 

Lite Skills IgFjjj^^ toHteachers 

\ 

while their s tudeuts ^compl^ted ~t he--s tu dent-surveyHE orms . 

Classroom observations were recorded on the *Lif e Skills*f or Mental . 
Health Classroom Observation Form . Generally, observations were scheduled 
a few days after Life Skills survey testing had been completed in the 
m classroom. For both the Fall \9 79 and Spring 1980 testing cycles, two 

observations were completed in each of the Life Skills classes — one during £ 
a Life Skills activity period and one during a regular classroom lesson. 
m> Jxi the control classrooms, only one observation was necessary for each 
of the two testing cycles, and it was scheduled for a regular classroonf 

o * » 

lesson. All observations^ were arranged at', the teacher's convenience, and 
in most cases they were conducted by the same person who administered 
testing to the students. Similar obssrvatipn* procedures were followed 

« r k 

in the Life Skills classes and in the control olasses. 



After all teacher outcome data/ were colie^tedHLiTGeorgia, the forms 

/'were sorted and shipped to RBS in Philadelphia for coding and processing. * 



r 

n-30 



ERIC 



48 



III. PROCESS -EVALUATION RESULTS 



Results of the process eva£u££tion activities conducted in relation 
to the £ife Skills program are presented in this chapter. The findings 
are summarized and discussed for the following areas: Coordinating Com- 
mittee, Activity Guides, TrainiirtLof Trainers, and Training of Teachers. 

• Coordinating Committee 

Tl^e process evaluation of fc^erork of the Coordinating Committee 

centered upon the interviewing of JoTnTT^nnmittee members during the sunk 

mer of 1978. The wealth of data co llec ted ffrom these interviews provided 

a source of valuable information which was later fedbac^, i j p T the 

planning process for, both the Life Skills prograto itself and the program 

evaluation. Associated with the interviewing effort Ws considerable 

work expended in sorting ancb|pif ting through a large number of documents 

and communications related to the development of the Life Skills ptogram. 

A summary of the findings^ feom the. documentation effort and the inter- 

viewing is ^r^seftted J.n thi\ &ap\gr. 0 Fpr a more detailed account-. 

ing of the Events leading. to the development .and dissemination of the 

' • s _ / ^ \ • 

Life Skills program, the reader is re°^rrfed to the documeiit entitled A 

Developmental History of the Geof^q Life Skills for Mental Health Pro- 



gram (Strandmark & Dusewicz, 1978)\ ' *\ 

There were twelve majoy, chtfontflogic^L milestones in the development 
of the Life Skills for Mental Healgji program that were identified for 
the purposes of the above report, jrhdse' cpuid be classified into two 
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major phases of growth of the overall program; Program Development and 
Pilot ProgramXmplementation. , ^ 



Program Developmen 




v 

The history of the Life Skills concept dates back to the creation 

of an Office of Prevention by the 1976 Session of the General Assembly. 

Under Section 88-603 of the Mental Health Services Act (Act Number 1136) 

i ■* 
the law .states that "The Department (of Human Resources) shall assign 

\ i. 

specific responsibility to one or more identified units of the Department 
for developing a coordinated prdgram of research, education and service 
dealing with all aspects of prevention of mental disability 

In February 1976. the Division of Mental Health and Mental Retar- 
dation established an Office of Prevention, with responsibility for 
reducing the occurrence of mental retardation, alcohol and drug prob^m§, 
and other mental— health- related problems; 

Prior to February 1976, prevention programming in the Division of 
Mental Health and Mental Retardation tyad beeh a fragmented effort. Most 
prevention activities resided within the Alcohol and Drug Section and/ the 



Office of Child and Adolescent Services. , The newly created Office of 
Prevention felt a need existed for a comprehensive prevention program 
which would address the major mental, "health problem areas. The Life x 
Skills for Mental Health program became the tangible outcome of this 
perceived need. ^ 




• / 
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The seven milestones associated with the development phase of the 
Life Skills program, along with the dates o'f their occurrence, are 
presented below. 



• July 1976 

• July-August 1976 

• September 1976 

• October 1976- 
September 1977 

• February 1977 

• January-May 1977 



Establishment of the Joint Committee 

Early interactions with local community 
mental health centers 

Development of a strategy statement 

Development of the Life Skills activity 
guides 

Selection of pilot atreas for training 
Development of teacher training package 



Life Skills Concept and Joint Coordinating Committee . A strategy 

\ « 

outline and timeline for development and implementation of the Life Skills 
frogram was promulgated irt May 1976. Towards _the_end.j>f . May,., the 

Single State Agency^for Georgia approved 9 the program. In June, Office 

i 

of Prevention staff received approval from the Director of the Division 
of Mental Health and Mental- Retardation to proceed with the program. 



^During* June and July the outline was circulated to the following people 

V 

within the Division of Mental Health and Mental Retardation for review 
and comment: the Director of the Alcohol and Drug Section, members of 
the Prevention Cdmmittee of the Division, the Prevention Subcommittee of 
the Governors Alcohol and Drug Advisory Council, community mental health 
center /directors, and superintendents of regional hospitals. 
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Concurrently, the Division Director sought and obtained approval and 
support for the program from the Commissioner of the Department op-Human < 
Resources. • The Commissioner agreed to lyfeet with the State Superintendent 

of Schools in an effort" tb~~oEtafn~"the Cooperation and involvement of the 

/ * 
State Department of Education. In preparation for this meeting, a proposal 

was developed for a joint working rqflationship which involved the follow- 
ing elements: 

• The appointment of several staff from the State Department of 
Education to serve as liaisons between the Office of Preven- 
tion and the State Department of Education; Office of Pre- 
vention requested representation from Health and Physical 

• Education, Guidance an^l Counseling, and Staff Develop- 
ment. 

■ / 

% # The development of a/mental health education g>iide which 

would provide clearly defined group aiid individual exercises 
and expected outcomes which teachers ! cduld use in< their 
classrooms. 

• 

• The development of£ a training program to prepare teachers to 
use the guide in/ their classroom. » 

j \ * 

• The establishment of cooperative relationships with community 
mental health Centers to provide in-service\ training and con- 
tinuing technical assistance to schools that; request the 
program. 

"The~e^tablis/hment of a cooperative relationship between local 
school systems and community mental health centers whereby 
schools would contract for staff development ; in menp&l health 
education tfrom community mental health centers and teachers , 
would receive, in-service^credit . 

/ . 4 
The State Superintendent of Schools Agreed to the plan in late July 1976. 

This was rapidy followed by completion of the proposal's first objective. 
/ I * ^ 

The firsy objective of the pronosal was to appoint Department of 

Education staff to serve as liaisons \etween the Office of Prevention 
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and the State Department of Educatipn. The State Superintendent of 
Schools selected two individuals each jri'om curriculum development, health 
education, guidance and counseling, atid one from staff development to ' 
serve in this capacity. These seven individuals along with the director 
and assistant director of the Office of Prevention and ^ corm^iity mental 
health center representative formed the Joint Coordinating Committee, 
The committee was designed so that responsibility for content and mechanics 
of the program could be shared and monitored by all involved parties. 
Other functions of the committee included a, content review o^ the activity 
guides, development of a training package for teachers, and facilitation 
of progtam dissemination through contacts made by committee membersT^ 

Early Interactions and Strategy Statement . * The Office of" Prevention 
began cultivating relationships with local CMHCs and undertook development 
of a strategy statement for the Life Stetlls for Mental Health program. 1 

>v * * ' \ 

In this effort, Office of Preventioita^staf f received suppprt from other 
central sj^ff, several community mental, health center pedple, and repre- 
sentatives of the State Department of Educa tion, J -h^ocument offered a' 
rationale for the program, defined terms, /and presented a step-by-step 
plah^vith a timetable for the development/ and implementation of the Life * 
Skills program. r, 

Activity Guides Development , Work began on the^^^Pfeiopment ,of " 
activity guides for teachers utilizing the Life Skills program in October 

J 

.1976 and continued for almost a year until August 1977. Office of 



Prevention staff utilized the following guidelines for .development of the 

J / 
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guides (as set forth in the Strategy Statement): 

* • Four guides will be developed for four age ranges: 5-8 
years; 9-11 years; 12-14 years; 15-18 years. 

• The guides will offer step-by-step instructions for struc- 
turing -experiences to help students learn interpersonal 
and intrapersorfal life skills and to explore critical 
issues they are facing. 

• Guides will be designed to be useful to teacher^ but also 
to yduth group leaders and others who regularly interact 

* with young people, 

• Activities in the guides will be designed to be integrated 
into regular .class activities so that a separate course 
requiring a special teacher will not be needed. As such, 

, - the guides w'ill be useful as resource materials for all 
tafachers tegardless of the subject area taught. 



Guid es .jjggg^d^ve lo ped indiv idually —Af ter the-preparation- of -a draf-t r 

. J:lve_guid,ej»as_^infcwith a review sheei: tb'appropr-iate-atate-Oeve-L 
individuals and organizations, all community mental health centers, a 
number of teachers, administrators, and counselors active in various 
* school systems in Georgia, and staff development personnel a* the State 
Department of Education. Responses were tallied by various members of 
the -Joint -Committee. The commit tek then met to discuss revisions. 

This information was then usfed by Office of Prevention staff to 
prepare a final version of each Life' Skills for Mental Health activity^ 
guide. Final printing of all four of the guides was completed by December 
of 1977. 

Pilot Sites and Training Package . In early February 1977/ a memo 



was sent to all CMHC directors and prevention coordinators. The memo 
invited them to participate in the pilot phase of the Life Skills program, 
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outlined what the^r commitment would be if they chose to participate , and 
delineated the immediate steps they should take r l^ interested. 

The Joint Committee selected pilot areas from\among the centers 
.-**at M ree ^ to participate. Criteria foV selection of pilot areas- in- * 
eluded: previous prevention related activities, staff available, ex- 
pressed interest in the program, demonstrated relationships with school 
systems, ancf perceived receptivity of school systems to the Life Skills 

» 

program. Eight centers were chosen for participation. 

Work then began on development of a training package in January 
m 

1977 with a meeting of 0ffice of Prevention staff and the Joint Committee 
__memb ers representing co mmunity mental health rentprg, At this-mee^ing-^an 
outline was developed for the training package which included a delinea- 
tion of skills needed to effectively implement the Life Skills prpgram • 

o 

and issues that merited inclusion in the training. The CMHC representa- 
tive agreed to coordinate development of the training package. 

- To* assist in development of the teacher training package, Office of 
Prevention staff developed and, received funding for a proposal providing 
consultation support from the U.S. Office of Education Southeast Regional 
Training Center. As a result, three consultants were eventually retained 
to develop various training components end to assist in the early training 

efforts,. _ „_! . . 

Four strategies emerged as being integral to achievement of Life 
Skills program objectives in the classroom. The four strategies and 
their respective purposes are outlined below: ^ 
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Listening for Feeling - To facilitate students 1 awareness, 
expression, and acceptance of their own feelings; to 
facilitate teachers' understanding and acceptance of "their 
students' feelings. 

Behavior Feedback - To help students become aware of the 
effect their behavior has on others; to enable teachers to 
express that effect in a way that will not damage the stu- 
dents' self-esteem, but will help the student to understand 
~ the effect and to make corresponding changes in h£s or her 
behavi&r. 

Values Clarification -.To help students become aware of, 
express, explore, and affirm theiif. personal values; to 
facilitate an understanding of the values of others. 

Role Playing - (a) To facilitate the demonstration of 
life situations and interpersonal relationships, and to 
.enable them to become real by providing students the 
opportunity to experience the thoughts and feelings under- 
lying their behavior, (b) To f acillt^J:e_JLearnin g r by both 
teachers and students, in identifying problems, exploring 



alternative solutions, projec ting consequences of actions, 

understanding causes of behavior, and developing'^bhe 
.ability to empathize. ^ 

A theoretical construct which tied these strategies together and 

linked them with the utilization of Life Skills material in the classroom 

was also adopted at this time. This construct was "affective Integra- 

tion." Its practical application points out ways that teachers can 

merge Life Skills activities with the cognitive materials they present 

in class. ~" 

The four strategies coupled with the affefctive integration construct. 

A* 

became the core of the training to be provided teachers. NBetween March 
and May of 1977, each area was expanded, illustrated witlj/examples from 
the Life Skills activities guides, and formatted to pfwide a two-day 
workshop for teachers. . . 
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Developers pt the training materials also drafted a set of objectives 
they considered attainable if the workshop was implemented properly. 

% i> 

These objectives are presented below. 

% 

• To create an awareness of the importance of affective education. 

• To increase understanding of the relationship between affec- 
tive and cognitive learning. 

• To increa^ teachers' confidence in fheir ability to conduct' 
Life Skills activities. > 

• To motivate teachers to implement Life Skills activities in N 
their classrooms. 

• To facilitate personal knowledge and*skill in Life Skills 
strategies. 

• To demonstrate selected Life Skills activities. ■ 



• To\prdWde a resource for additional training, consultation, 

j and "materials-? — ^ 



A draft of the workshop format was approved by the Joint Committee 
in M^T 1977. To determine th£ efficacy of the workshop format, Office 
of Prevention' staff arranged with DeKalb County schools to conduct a run- 
through of the materials with 17 teachers and administrators.* Sessions 
were conducted- on May 23 and 24, 1977"^ the GMHC representative and, two 
6f the consultants. Feedback /rom the .participants was solicited and 

then reflected in changes made to the workshop materials. 

* 

Pilot Program Implementation . With* the completion of the seven mile- 
stones associated with program development, the Life Skills program began 
to shift its emphasis* toward a pilot program implemen tation, or program^, 
"try-out/ 1 This pilot implementation served as a field test for the 
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program and was a precursor to ? the dissemination an<J diffusion activities 

J0 

which would come later^ The five milestones associated with the pilot 
program implementation phase of Life SkiMLs, along with the dates of 



their occurrence, are presented below: 
V 

• June 1977 



Training of the pilot community Rental health 
center teams 



• August-October 

1977 

'C 

^ • September 1977 

•^^oVember 1977- 
June 1978 

• March 1978 



Development and use of slide presentation 



Training for certification renewal Credit r 

'Organization and activities of the state 
training team 

Solicitation of teams for statewide imple- 
mentation 



Training, of pilot Teams and Awareness Presentation . The working 



group responsible for the development of the teacher training workshop 

also designed and conducted the first training session JCMHC training 

teams. The format for t^iat first Training of Trainers workshop 
# 

called for essentially a "walk through" of what might be considered a 
we 11- implemented teachfer tfcaining workshop . The intent was learning 
through modeling. Time was allowed in the workshop format for discussion 
of questions and problems relating to training strategies. A block of 
time at the end of the workshop was also set aside to provide "tips for 
trainers." A tptal of 15^ session hours was planned. 

H The workshop was held on June 7, 8, and 9, 1977 at the Center for 
Continuing Education, University of Georgia. Thirty-four CMHC team mem- 
bers were trained'. Of these thirty-four, eighteen were mental health 
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workers, eight were educators, seven considered themselves "other" (this 
group included four individuals who saw themselves as educaf'&rS and mental 
health vorkers) , and one individual declined classif ica^ior^ At the close 
of the workshop, participants were asked to evaluate^the experience along 
a number of dimensions. On one of these dimensions, participants were* 
asked to rate the extent to which the workshop met its stated objectives. 
Most participants felt the^obj actives were sucyessfully attained. 

In October 1977, a follow-up workshop was held for the pilot teamsv 
The workshop had two objectives: to help solve problems encountered in 
implementation of teacher training workshops, and to spend additional 

training time in the four strategy areas (listening foj" feeling, behavior 

t v ._ 



feedback, values clarification and role playing). Eighteen team memb 



ers 



(twelve mental health workers, two educators , and four "others") attended 
the two day workshop. The wdrking group that -ran the" June workshop also- 
ran this follow-up. To prepare for specific problems, a brief question- 
naire was distributed to all team members six. weeks prior to, the scheduled 
workshop. * 

Response to this workshop was" generally favorable. Almost all team - 

members were pleased they participated. Over 90 percent felt t;heir \ 

* ' ! * ' * 

expectations were at least "sometohat realized." 

* \ 

Between August and October of 1977, a slide/sound presentation was' 
developed to introduce the Life Skills for Mental Health program. It 
wa£— ctesi^ned to ge~Serate awarenessfoFltTie goals and objectives of~the 

program, the types of activities involved, and the kind of outcomes to 

,/ 

ft 

be anticipated. The awareness presentation runs 16 minutes in length. 
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All CMHC teams trained received copies of the slide show. It was used 
on the local level to introduce interested groups to the Life Skills c^n- 
' cept and to orient participants ±n teacher training sessions. On the 
state level, th^ slide show was presented to the Alcohol and Drug Section, 
representatives of the Citizens Advisory Council on Drug Abuse, the 

. Georgians chool of Alcohol 'and Drug Studies, the Steering Committee of the 
Governor's Advisorj^Council on Mentai Health and Mentai Retardation, the e ^ 

Prevention Task Force of the Division of Mental Health and Mental Retar- 

♦dation, a representative of the Prevention Branch of the National Insti- / «l 

tute on Drug Abuse, and to other interested agencies and individuals 

within Georgia anci other neighboring states. 



Training for Certification Renewal Credit , In September 1977, 



7 



the State Department of .Education approved the Department of Human 
Resources 1 Staff Development Plan for Certification Renewal Credit, The 
plan represented one of the most significant accomplishments of the Joirt* 
Coijunittee. It meant that teachers could earn credit, toward certification 
renewal by .participating in a somewhat modified Life Skills training pro- 
gram designed to consist of ffrs ^ty c ontact hours. The twenty hour prograu 
is broken down as follows: 

• 14 hOurs^ Inservice Workshop (the same workshop presented 

to all teachers, with more time to practice the 
strategies) ■> ^ 

• 1 hour Practice Plan (to be completed by the teacher 
t _ after the, workshop and approved by the train- 

ing team) 

• 4 hours , Follow-up (provided to teachers after they have 

had a chance to try the strategies with Life 
Skills activities in their classrooms) 
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4 1 hour 



Implementation Plan (completed by the teacher 
.after follow-up and approved by the training 
team) 



After the twenty hours are completed, teachers are observed in their 
classrooms to verify that they have met the stated competencies and that 
they are using the Life Skills resources appropriately. This teacher 
assessment is usually completed by members of the training team, who 
frequently receive assistance from the school system. Training teams 
"Rave the option to offer Life Skills for staff development credit. 



x 



State Training Team and Statewide Implementation . During November 
and December of 1977, Office of Prevention staff recruited six individuals 
from the eight pilot teams to serve as a s-tate-level training team. The 
team's fufifction was envisaged as three fold: 



• To provide technical assistance in training- and advanced * . 
training as needed to current locai teams in the pilot ♦ areas 

• To provide basic training to new members* of current teams 
as vacancies occur and are filled. * ' 

< \ , 

• To provide trainingHri special situations to schools or 

other groups in areas where training is not available from 
tfie community mental health center. * * 

By recruiting six team members, Office of Prevention staff sought to 
minimize the time any one individual would spend in state training acti- 
vities, as aach team member alSo haa full-time job responsibilities. 

A special training session was held for team members on February 21 
and 22, 1978. This session allowed team members to arrange working rela- 



^rtorrshlpB^with'each other and also provided intensive training from the 
consultants who conducted the original pilot training of trainers workshop, 
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Statewide implementation of the Life' SkiUs program was initiated 

with a mefuQrandura dated Match 14, 1978~from the Director of the Division 

of Mental Health and' Mental Retardation to CMHC program directors . and 

prevention coordinators across the state. The memo invited centers to 

t 

participate and*informed them, of .their responsibilities if they chose to* 
do so. . A total of 11 centers responded affirmatively. 

This solicitation represented the ehd of the development and pilot 
implementation stages of the Life Skills program and marked' the beginning 
of a new dissemination/diffusion phase. 

With this change in .program mission came new challenges £o be faced. 
As the program gained wider visibility and utilization, a greater > 
.scrutiny of the merits of the program itself had to be made within^the 



context of an overall formative and summative evaluation plan. 

. ? 

Summary of Interviews with Joint^Qpmmittee Members 

This section presents a discussion -of issues arising out of the 
development and trial implementation of the~Life Skills Program as well 
as the perceived challenges fajled by the program as it began "its 
statewide dissemination/diffusion effort. These issues were identified 
and Addressed in interviews with Joint Committee' members conducted in 
Summer 1978. 

In general, committee members felt that the future held considerable 
promise for the Life Skills program. Cited as an example was the fact 
that over half of all CMHCs in Georgia had already received Life Skills 
training. However the committee members-also saw some unresolved "issues 
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which posed potential problems for 'the Life Skills program. These issues 

4 

. are discussed below and are then followed by, some additional supportive 
observations. w 

One issue identified as particularly problematic for the program, 
aqcording to committee members, was the question of whether local school 
systems should be charged for Life Skills training workshops. Committee 
members were sWhaf polardSed on this issue. Members from DHR expressed 
a concern th^t team members 1 energies would be redirected toward cost- 
reimbursable activities unless there^was some charge for their training 
services. In some catchment areas, this had become a critical issue due 
to greatly increased demand for Life Skills training. Unless team mem- 
bers in these CMHCs were able to charge f\c their services, there existed 
the real possibility that the Life Skills program in these centers would 
be curtailed. . , % 

On the othen: hand, committee members from the Department of Educa- 
tion' expressed thp opinion that local school systems should recel^^he 
training without cost because the State Department of Education par^ici- 

V V £ v. ' 

pated in' the initial development of the program. i' 

Another issue, of particular concern to those committee members ' 
from DHR, was the problem of staff turnover on" the training -teams*. A* 
'number of team leaders and team members trained in the pilot^group and' 
the »78 cohort had either left their original, positions 'or had been re- 
assigned to other responsibilities within their respective CMHCs. Since the 
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Prevention Unit could schedule only one major training session for team , 
members per year^ this seriously limited training activities in the state 
level that might otherwise serve to ameliorat^ this problem.^ Committee 
members and Prevention Unit staff acknowledged that some policy to keep 
track of turnover and to control the training of potential team members 
needed to be formulated. 

All committee members felt that, overall, the future did indeed 
appear bright for the Life Skills program. ' Over one half of all CMHCs 
had thus far received training. School systems were generally receptive, 
to the program, and in some areas demand had exceeded expectations. More- 
over, informal feedback suggested that teachers were satisfied with the 
training experiences they ^ceived. 

All committee members expressed optimism concerning the joint work- 
ing relationship between DHR and the Department of Education and the ex- 
tension of this cooperative relationship to the local level. They 
believed that: school counselors woufd become more comfortable referring 
students to CMHCs; schools would call on CMHCs for assistance in areas 
related to the Life Skills program; and CMHC staff would develop a x more 
complete understanding of the school environment. Finally, a number of 
committee members were optimistic that the cooperative initiative embodied 
in the Life Skills program would carry over to other efforts. One mem- 
ber .cited as an example a j olat-^educational effort- then-being-contem- — 
plated by the DiviSon of Physical Health within DHR and the State 
Department of Education. 
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. Activity Guides " 

For the purpose of reviewing the Georgia Life Skills; for Mental 

Health* Activity Guides, a Consumer Evaluation Panel was convened in 

- I • - ! 

Macon, Georgia on October 28, 1978. \ This meeting was sponsored by Research 

for Better Schools, Inc., as part of jLts continuing, comprehensive, and 



)orted by 



statewide evaluation of the Life Skills program supported by a grant from 
the National Institute on Drug Abuse-. 

This section presents a summary of the procedures followed and re- 
sults obtained from the Consumer Evaluation Panel. A more complete des- 
cription can be found in the separate document entitled, The Life Skills 
for Mental Health Consumer Evaluation Panel Report (Swisher , Martinson 

1 : - ■ : 1 . 

& Dusewicz, 1978) . 



/ 



^ Evaluation Panel Procedure^ * * 

• ■ 

Elaborate planning and participant selection procedures were under- 

t t 

taken in convening the Consumer Evaluation Panel. The purpose of the 

i 

panel was ^to bring together consumers of the Life Skills program for the 

purpose erf evaluating various aspects of the program with respect to 

.- 

effectiveness, efficiency, and utility. It was hoped that, through such a 

meeting, a better understanding of the problems, difficulties, and areas 

of .application of the Life* Skills program could be secured. In keeping 

with these aims, £very effort was made to gain a wide geographical rep- 

A 



reseritation while at the sa^ time providing" for representation of 
teachers , at each of the f our , Life Skills activity guide age groups^. 
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The Consumer Evaluation Panel consisted of 13 teachers from seven 

school systems across Georgia who participated in the LifeiSkills Teacher 

I * ' \ 

Training workshop in 1977 and had implemented the Life Skills program ip 

tHeir classes. . Represented, On the Panel were three men and! ten women. 

S tbject/specialty arears included early childhood, special learning dis- 

a>ilities, .gifted* children, math^ English, art, choral musid, science, 

/ * I 

aid social studies. Frequency dist^butiofc^for age, educatjion, and 

years of /teaching experience are presented in Table III-l.- 'j 

Table III-l | 

/ 

{ / JProfile of Consumer Evaluation Panel Members 









Percent 


Variable 


Categories — 


'Frequency " " 


— - 5f Total" " 


Age 


Under 25 


2 


.15, 




25-34 


8 


62 




35-45 


3 . 


23 




Over 45 * 


0 . 


• 0 


Education 


B.A. 


6 


46 




B.S. 


3 


' 23 




M.A. 


2 


15 




< M.Ed. 


2 


15 


Years of 


Less than 3 years 


7 


54 ' > 


/Teaching 


4 to 10 years 1 


3 


23 


Experience 


More than 10 years & 


3 


23 



These members had originally decided to participate in the Life Skills 
training for a variety of reasons including: it seemed interesting, 



for self-growth, for help with teaching, for staff development and 
college credit, it was free, release time was provided, and/or their 
principal asked them to attend. 
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The Panel members represented ' each* age gro,up^of the guides. Four 



teachers evaluated the 5-8 years guide; three evaluated the 9-^kl £ears 

> • * 

guide; three, the 12-14 years guide; and three, the 15-18 years guide. 
The Panel met from 10:00am to 4:00pm and completed an extensive packet 
of evaluation instruments that covered all sections of the activity guides* , y 

The panel met with the evaluation staff for one fulj. day and CQm- 
pleted an extensive packet of evaluation instruments (see Appendix A). 
These instruments wer'e designed- to assess the educational v§iue, communi- 
cability, motivational value, utility, and format of the guides and Were 
organized into five sections: overall" pi^Dgram use; rationale, format, 

and clarity o,f text; activities; helpful notes; and anec'dotes. After 

„ _ . „ . . „ 

each section," the responses of individual teachers were discussed by the 
entire panel. The discussions were designed to b'e an integral part of 
the panel sessions. 
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^val uation Panel Results 
r— 

» 

The "overall program use 11 section of the evaluation packet examined 
how the activities were conducted. Most o^ the Panel members used the 
activities ihore deliberately at first. Some used them as part df'a re- * 
search project or as an experimental mini-course, ^ater, -the activities 
were used more routinely and more often at teachable moments. A1J mem-/ 

bers kept the guides in h andy locations for ready referen rp. THp p^tW* 

- . — 

membets reachedT consensus on the following major issues concerning imple- 
mentation of the guides: 
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• The glides should be distributed at the beginning of the 
training workshops, rather than after their completion., 

• Trainers should provide more resource materials. 

_ 0 



• The guides should contain more activities. 

• More help should ^e provided to teachers in anticipating % 
c problems they would encounter in implementing the guides 

and suggestions far dealing with them. This included 
such concerns as: opening and closing of Life Skills 
\ % % ctivities; probing questions at the end of activity 

sessions; young children copying each other's responses; 
exercises turning into put-downs; and reluctance of stu- 
dents to share feelings. 

The "rationale, format, and clarity of the text 11 were also assessed 
,by the Panel. j The principal results were as follows: * 

• 'Teacher responses to the six rationale questions indi- 
cated a high agreement with the basic assumptions of the 
Life Skills program. * - 

^ ' J? ' 

Teachers felt that the activities were well written and 
f 9 * that they were relevant and feasible for classroom use. 

• The 5-8 and^ 9-^11 level teachers indicated that they found 
« * the format slightly less appealing than the 12-14 and 

m 15-18 level ^teachers, because they felt a need ^f or a 
' f key 'topic index in the guides. 



The* "activities' 1 section of the evaluation packet evidenced the 
following Results from the teacher questionnaires. 

• Teachers found most of the activities professionally re- 
warding and believed- that their students genuinely liked 
the activities 

«& 

• The 5-8 level teachers varied the- activities more than 
the other teachers. * 4 

• The 5-8 and 9-11 level teachers used the activities more 
frequently as a mini-course, while the 12-14 and i5-18 
level teachers used the activities more frequently at a 

t . natural moment «or as an interesting part of the subject 
matter or curriculum. 

• The "self" sectiotfof the activities is used more frequently 
than the "feelings" and "others" sections. 
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• „ The 12-14 level teachers tried the widest variety of 

different activities, 

• The- 15-18 level teachers, tried the fewest variety of , • 
d if f erent- -a€t4virtie s b ut- used-Hfrhem---f requently . 



• The 5-8 level teachers ftund some of the activities (e.g., 
^writing an essay) too difficult for kindergarten and 
first graders. 

The "helpful notes 11 section of the questionnaire asked the teachers 
to indicate how much they used the suggestions printed at the beginning 
of the guides. The*responses indicated that the teachers don't always 
post rules, discuss the activity before starting, or conclude with a sum- 
mary activity. The responses did indicate, however', that all teachers 
used the activities frequently. 

In the "anecdotes 11 section of the evaluation packet; the teachers 
reported sj^eta^ effects they believed the Life Skills activities had <A 
the stutt^nts. All of the effects reported were positive. Some of the 
effects mentioned were: improved self-concept, better relations with 
teachers and other students, and the acquisition of more respect for 
other people. More observable effects* were fewer discipline problems, 
more cooperative and attentive behavior* and enhanced vocabulary skills. 
One very important classroom effect reported was that the students be- 
came more open and trusting. They became more willing and better able to 
articulate tfceir feelings. The teachers \ in turn, developed a more per- 
sonal relationship with them. , . 
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Conclusions apd Implications 

The basic SBncerns of the Consumer Evaluation Panel were to assess 
the educational value, communicability , motivational value, utility and 
format of-'the guides. Upon analysis of the Panel's results, it becomes 
clear that these concerns were met. 

The responses of the. Panel members indicated -that the guides were 
very valuable as a teaching instrument. The. teachers had all read the 
guides and used many of the activities. They all kept their guides' in 

« 

accessible locations. The positive effects reported in the questionnaires 
and during the discussions indicated that the Panel member-s all believed 
-the guides have great e'ducational value. 

The results from the Panel showed that the guides have communicated 
the purpose and .design of the activities to the teachers. Many of the 
problems reported were related to the training and not <to the guides. 
These problems pointed to the need for changes in training to be considered 
by the Life Skills staff. Other problems in implementation seemed to have 
occurred principally because the suggestions stated in the ."helpful notes,", 
section .of the guides were not always followed. „ — 

The results from the Panel also indicated that' the teachers recognized 
a need for Life Skills activities in the classroom and were very motivated 
by the guides to try them. Many of the problems they had in implementing* 
the activities were^unrelated to either the Life" Skills training or to 
the guides. Th(* teachers felt there was often not enough time for the 
activities or "that their -subject matter (e.g., math) precluded using Life 
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Skills. Frequent use of the activities, however, might result in better 
integration with any subject. 

The utility and format of the guides were considered excellent, but 

it was felt that a key topic in<|ex was neede'd. This would help teachers 

v 

to locate more readily activities that deal with similar issues. 

In reviewing the results of all areas examined by the Panel, the 
following recommendations were found to be the most important as outcomes 
of the panel session: ' 

CThe guides should be incorporated into the training work- 
shop. 

» * 

• The guides should have a key topic index. 

• The number of activities in the 5-8 level guide should be 
expanded to incprporate more activities* appropriate 'for 
kindergarten and first-graders. 

A summary of some of the more significant findings was prepared as 
a handout for the November 1978 Training of Trainers Follow-Up Workshop. 
This handout was comprised of findings "believed to be particularly rele- 
vant to use of the guides during training (see Appendix A). The purpose 
of this summary was to provide insight into the needs and problems faced 
^^teachers in implementing Life Skills programs, thus assisting trainers 
to better prepare themselves and their workshops to be optimally re- 
sponsive to, the training nee^s of the teachers participating in those 
workshops. # > 

Overall, the Consumer Evaluation Panel session proved to be a very 
worthwhile evaluation effort. The results 'were presented to the Life 
Skills staff, and suggested changes in the guides and in the training 
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were communicated. The Panel embers 1 overall reactions to the, Life 
Skills program were* very positive and their remarks were thoughtful, con- 
crete; and useful. If these teachers \re typical of teachers trained in 
Life Skills, the training and the uides have been very successful^ at 
presenting the program. 

Training of Trainers - 
The raining of rainers constituted a critical component of the 
Life Skills implementation process. It was important that both the se- 
lection and training of the local training teams be accomplished in an 
effective manner if the program itself was to*be successfully implemented 
in the schools. This section examines three aspects of the evaluation 

of the graining of trainers process: the Training of Trainers Workshop 

P ' * 

evalu^ftion, the training team coordinator interviews, and the CMHC trainer 

questionnaire. € 

Training of Trainer Workshops 

Between June of 1977 'and May of 1979, a total of eight Life Skills 
Training of Trainer^ workshops were held. Table III-2 shows the dates 
and numbers of participants for each of these workshops. 



i 
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Table III-2 ^ ' 

Participation in Training of Trainers Workshops^ 



Date 


* Numb er o f 
Participants 


June 1977 


32 


October 1977 
(Follow— up wprkshop) 


18 


July 1978 


. 50 


November 1978 
(Follow—up workshop) 


38 

s 


January 1979 


16 

i 


March 1*979 ' . 
(Affective Integration workshop *• 
follow-up) 


25' 

ft 


April 1979 


35 


May 1979 

1 


.19 



A total of 152 persons from 25 (of 32) CMHCs received training at 
these workshops. Background information from the evaluation forms was 
-used to construct^ the profile shown in Table III-3. Some participants 
did not fill out evaluation forms'. The information from the, October 
1977, November 1978, and March 1979 follow-up workshops is omitted be- 
cause it is redundant 
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Table III-3 1^ 
Profile of Training of Trainers Workshop Participants 



Variable 


Category * 


Frequency 


Proportion 


Ana * 


Tin n o it / i vo arc 

uiiuci z. j ytdio 


% 

7 
/ 






£ J J4 


7A 


• jj 








• ZD 




Over 45 ' 


19 


.14 


Education* 


BA/BS 


30 


.33 




Master's 


51--- 


.56 




Ph.D/Ed.D 


2 


.02 




Other 


8 


.09 


Field: 


Mental Health 'r 


83. 


.63 




Education 


36' 


.27 




Other (includes those 


13 


.10 




who marked both MH 








and Education) 






• 

Years Experience in Field: • • 




* 


Range : 


1 to. 21 years 






Mean : 


7. 11 years 






*This information, was not reported for 


the-^une \ 


L977 workshop. # 



er the CMHC training teatjis wer^ established and had completed the 

Training of Trainers Workshops, two problems arose that had some impact 

on program operations* They were as follows: - . 

• Slow and delayed scheduling of teacher 'training workshops 
by CMHC trailing teams , *' «* 



• A ^general Tack of formal and established communication 
vehicles for monitoring activities of the training tdaras 
and of school districts implementing the program. 
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From continued telephone contacts with training team leaders, it was 
apparent that the scheduling of teacher training workshops was proceeding 
at a .very slow pace in the initial year of training. Thi| was believed 
to be partly the result of two factors. First, because they had the in- 
itial and not the follow-up Training of Trainers Workshop at the beginning 
of the academic or school year, many training teams felt less confident 
in their ability to conduct complete teacher training workshops and even 



lacked confidence in their ability tb solicit interest from among school 
districts. < Second, on the'^other hand,' many school districts had already 
made plans for other inservice workshops and sessions for their teachers 
and found it ^difficult at the beginning of the school year tp. rearrange* 

i k 
f 

this schedule to accommodate what otherwise would have seemed an attrac- 
tive and important program. To .remedy this situation, th^e evaluation 
team suggested. changing the dates of the initial Training of Trainers 
Workshop to a spring scheduling in order to allow sufficient time for 
preparation of training teams and involvement o£ school districts prior 
to start of the next school year. m * 

The general lack of an established cojqamunication vehicle for moni- 
toring, the -activities of the training -teams and the school districts 
which had adopted tl^e program compounded th§ scheduling problem. Since 
training teams were virtually on their own after completing the Training ' 

of Trainers' Workshop , there was no assurance that their activities^ would 

' *^ <* « "\ • 

« * J , 

be recorded or documented and Inade known in some .way toyche evaluation 

staff or program staff. Moreover*, even if "it could be assured that thfcs 
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information would become known to the evaluation staff, there was no { 

gssurance that the transfer of inf oirraation would occur in a timely manner. 

g Tn order to resolve some of these problems., several steps were taken. 
« 

Efforts were begun b^ the evaluation team to ^develop a management infor- 
mation system for tracking both teachers trained- and school districts 

f 

adopting the program. A common participant registration form was developed 

'V u 

for use with both Training of Trainers and Training of Teachers Workshops, 
and the central forwarding and filing of these registration forms was en- 
couraged (see Appendix A). This mechanism helped to alleviate somewhat 
the unanticipated problem of not ha^iwg a, current file of information on ' 
the ^activities of trainers 'and the absepce of an effective monitoring cap- 
ability. 

Individual evaluations of eacfi workshop* from July 1978 t^o May 1979 
were conducted by RB& evaluators and results fed back to DHR program staff. 
For each workshop, a workshop^ evaluation questionnaire was 'administered 
together with an attitude survey and observation schedule. These evalua- 
tions are presented in some detail In the first and second year annual eval 

uation reports on this study, published by Research for Better Schools in 

t 

1979 and 1980 respectively. Samples of these evaluations are presented 
in the following ^pa^es. • 

July 1978 Workshop . For the July 19^8 Training of ^Trainers Workshop, 
there, were 39 respondents -to^ the instruments and questionnaires that were 
concerned with assessing four aspects oL.the workshop: attainment 



of workshop objectives, teaching techniques, content" of the workshop, 
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and the total experience of the workshop . The results of this workshop 
evaluation appear in Table III-4. 

In examining these results several particulars should be noted. 
With respect to attainment of workshop objectives, participants seemed 
to believe that all objectives had been achieved successfully. This was 
indicated by mean ratings for ea^h of the seven workshop objectives ex- 
ceeding the 3.4 1e£el. If the class interval for uncertain responses is 
interpreted .as being those lying between the values of 2.5 and 3.4, 
then all mean ratings appear to fall in the range: somewhat to very suc- 
cessful. The least successful of the objectives, attaining^ 3.5 mean 
rating, was' that of developing and/or increasing trainers '* confidence in 
/their ability to conduct Life Skills teacher training workshops. This 
finding as well as other participant feedback was taken into considera- 
tion in recommendations by the evaluators for the planning of the Train- 
ing of Trainers Follow-Up Workshop, 

With respect to participant ratings of teaching techniques employed 
during the workshop", the most successful techniques seemed to be those 
involving role playing and the audio-visual presentation. The' least su 



cessful techniques, falling into the uncertain range, involved the devel-' 
*bping of lesion plans and an improvised "rap session. 11 



4 
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Table III-4 



Results tff July 1978 Evaluation .of 
^the Trainxt^of Trainers Workshop 



Topic 

Attainment of Workshop Objectives 



1. To increase understanding of the 
importance of affective education. 

2. To increase understanding of the 
relationship between affective 
and cognitive learning. 

3. To reinforce the rationale for pro- 
moting positive affective and 
cognitive growth as a preventive . 
strategy in mental health. 

4. * ? To introduce atuf demotistrate sel- 

ected classroom activities in the 
Life Skills piogram. 



To facilitate trainers' personal 
knowledge and skill in Life Skills 
strategies./ 

^To develop and/or increase train- 
*ers f conMdence in their ability 
to conducCvLife Skills teacher 
^service wb^kshops. * 

To provide resources 'for addi- 
tional training, consultation, and 
materials. 



Mean Ratings 

(5 = Very successful... % 
Very unsuccessful) 



4.2 



4.2 



4.1 



"T.3 



' 3.9 



3.5 



4.2 



I 
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Table III-4 (cont.) 



Topic 



Content 



1. Rationale and objectives of Life 
Skills program. ^ 

2. Listening for feeling. 

3 . Behavior feedback . 

4. Values clarification. 

5. Role playing. ^ 

6\ Demonstration of Life Skills 
activities. *' 

7. t Explanation of affective integra- 

tion. 

8. Developing affectively integrated 
lesion plans. 

t 

9. Evaluation of Life Skills A 

4 

10. Guidelines and format for teacher 
inservice „ 

11. Tips for trainers. 



Mean Ratings 

(5 s Very informative... 
1 = Very uninformative) 



4.2 
3.8 
3.7 
4.1 
4.5 

4.3 

4.2 

3.6 
3.6 

• 

3.6 
3.6 



^ Total Experience 



1. How do ypu feel about the workshop? 

,2. To what exte#t was the workshop 
/ 'successful in meeting yotfr -expect 
tations? - * * 



3. Hot^ satisfied were you with, the 
opportunity for participation^ 



'(5 = Vejry positive,.. 
1 Veiry negative) 



9.«7 



3.4 



4.6 
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^eble III-4 (cont.) 



° Topifc . 
Teaching Techniques 



1. 
. 2. 
3. 




Lecture 



Group Discussion, 

Skill Practice Exercises: 

a. Listening. for Feeling 

b. Behavior Feedback 

> c. Values Clarif icatign 
. d. *kole Playing 
e . Developing? Lesson Pl^ns 

4. Slide/Show Presentation 



Handouts ^ 
Rap Session 
Panel 



v 



(5 
1 



Mean Rating 

Very effective. . . 
Very ineffective) 

3.8 - 



'3.8 
3.6 
• 4 
4.5 
3.4 

4.5 

4.1 

3.3 

' 4.1 



> i 
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With" respect to the conten^of t&e workshop, all areas were deemed by 

. the participants to be informative, at least to some decree. The most 

- • V • 
informative content, areas ^were judged to* be those dealing with role P4&X^ 

ing and with demonstration of the Life Skills activities. A substantial 

proportion of 'participants were«already familiar with the four Life Skills 

' "* J) 
strategies of listening for feeling, behavior feedback, vaLtxes clarifixa- 

tion, and role playing. ' , 

In evaluating the total workshop experience, participants tended to 
feel somewhat positive about> the workshop as -a whole but were somewhat 
uncertain, as to the extent to which the work shop was successful in mjeet^ 
ing their expectations. Nevertheless, thfey tilled to be satisfied w^th 
the opportunity to participate in the workshop, 

The Training of Trainers Workshop Attitude Survey ( Mental Health 

Opinion Survey) results" appear 'in Table III-5. This survey is a pre-post 
•» 

measure that was given to all participants at the wo'rkshop'. An examina- 

tion of the results showed several things that should be noted. When 

adjusting for polarity of^ems, 23 fit a total 29 items were fourfd' to 

exhibit,mean pre to posttest ctt^ge or sh^ft in attitude toward a^more 

favorable position with respect to khe Life Skills program. These posi- 

tive changes ranged from .03 to .43. 

^Noyfeiober 1978*Follo*i-Up Workshop , JFor the November 1978 Follow-Up 

Workshop, there were a total of 38 participants who attended. TKe work- 

shop agenda included: an. opening s'essiqn, a problem solving session, 

t * • 
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Table III-5 

Responses to Mental Health Opinion Survey 
from July 1978 Training of Trainers Workshop . ' . 





w " Question 

• 


Pretest 
Mean 


Posttest 

M OS n 
i lea 11 


T 

Change Score. Adjusted 
r or roiaricy« 


1. 


Counselors are more responsible than 
teachers for the mental health* of stu- 
dents • 


t 

1.57 


1/71 


• 

-.14 . 


« 


• • 
Good mental health is desirable but not 

absolutely essential for maximum class- 
room* learning. c 


1.57 


1.29 


+ .28 1 


3. 


The teaching of values^'has no place in 
the classroom. • 


1.29 


1.07 


* * +.22 


4. 


When children are taught to express 
ffeelings, they can lose control. 


2.00 


1.86 


+ .14 


5. 

t 


Basic Skills need more emphasis than 
Life Skills in "the schools today. 


1 2.00 t 


1.71 


+ .29 


6. 


The time spent in school each day"^s^not 
enough to change anyorie r s behavior. • 


1.14 


.1*36 


1 . -.22 


7; 


Affective Education is not ^elated to 




• 






Basic Skills 


1 AO 

1. Hi 


1 .14' 

• 


+. 29 


•'8. 


Life Skills 'is best taught as a sep- 
arate course 'and not integrated with * 
other content areas. 


' • 1.43 


1.14 


+.29 - 


9. 


Students should be taught to share and 
publicly affirm their values'., 

■ — ■ f i 


3.23 


3.54 


* 

+ .31 



* Positive changes indicate shifts favorable to the Life Skills Program, while negative 
— —ehanges * indicate unfavorable program related shifts. 
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Table III- 

• 


•5 (cont.) 


* 


a 






Pretest 


— % 

Post test 


nViAriPP Srnrp AH"1n^fpd 




Question 


Mean 


Mean 


' for Polarity 


10. 


Students should be taught to a'ct upon 










their values. 


3.64 


■ 3.86 

4 


+.22 


11. 


The cognitive and affective are com- 


- 








pletely different realms and evolve in- 










dependently and uniquely within each 










individual. 


1.50 


1.43 


+ .07 


12, 


Unless knowledge is related to an affec- 


• 


« 


ft 




tive state in the learner, the likeli- 










hood that it will influence behavior- is 










limited. 


3.21 


3.54 


+.33 


13. 


Children are generally unaware of the 










•effects their unacceptable or disruptive 






•a 




behavior has on others .around them. 


2.21 


2.71 


. . _ +.58 


14. 


Disruptive behavior when dealt with in a 






« 




punitive way* often increases. 


3.57 


3.71 


+ .TA . 

\ 


15. 


Telling a student how he/she should be- 


- 

• 




\ 




have takes away the opportunity f of the 










student to' learn how his/her behavior 


• 


0 


. \ 


16. 


affects others. 


3.00 


3.50 


+.50 ) 


It is nearly impossible to encourage be- 




• 






havioral change without risk of damage to 






• 




the student's self-concept, or. to the 










teacher's relationship with the student. $ 


, 1.43 


.1.29 fc 


t +.14 


17. 


Students should.be taught to choose their - 










values £rom among varied alternatives. 


3.71 


3.-93 


+.22 


18. 


The tdacfiing of personal values should be 


* 








TP 1 poa fpH f n fVi P Vinmp anH nnt* t*ViP a r*K r» r» 1 o 


X . DU 

* 
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Table III-5 (cont.) 



1 




f 

\ 

'' Question 


Pretest 
Mean 


Posttest 
Mean 


Change Score Ad-jus'ted 
v ' for Polarity 




.19. 

• 


It is 0 wrong to /teach children to accept 
personal characteristics which canno|g 
be changed. 


1.71 


1.21 


+.5Q ;, 




20. 

• 


^ftfuncfion of the sfchool's should be * 
that of preparing students to deal with 
* conflicting and changing values, and to 
be able to make their own v&lue deci- 

c "f nn a 3 

t> JLuns • 


•> 

3.57 


t 

* 

3.71 


1 

+.14 • w 


• 

M 
M 
M 


21. 


The way knowledge af fects , one's' behavior 
occurs only in the degree to which the 

individual has d"f QhfWPrprl -ft*Q norcnn'n ~\ 

******** "QO # V C i. CU JLLo |Jcl oU I lei X » 

meaning for himself or herself. 


t 

3.64 


3.93/ 


+.29 


U> 

ON 


2 : 2. 


It is important to openly express feel- 
ings to others rather than camouflage > 
them. 


3.?9 


3.46 


> + 4 7 




23. 

t 

»* 


Whenever we solye, or attempt to solye, 
a problem for .a studient we take a 
learning opportunity away fyom the stu- 
dent. • * 


9 

3.50 . 


3.71 


<• 

+.21 




practice sessiops^a mini-workshop" presentation session, a pan^l ses- 
sion, an evaluation session, and a general session., 

The opening session stressed that the follow-up wdrk?l>op was con-r. 
stru£te& in, response to feedback from the initial workshop participants: 
It was indicated that the workshop leaders would merely serve as facili- 
tators. That is, &ey would set up the structure but the content would 
depend upon tfre participants. * ' 

• . For the problem solving session the participants were divided into 
two groups and charged with discussing general problems encountered in 1 
Setting up and giving Life Skills Teacher Training Workshops and with ex- 
ploring poMibUsalutlqps. Mojs_tL-oi the reams had as-yet-^-iven-ao-feeacher 
training workshops, and consequently few problems based on actual experi- 
ences were discussed. The sharing of these few experiences, however, 
appeared to generate great interest among inexperienced training .teams 
and. to instill a greater degree of confidence within £hem. 

Dur *g&J&5, P ractice session, the groups were further divided into 
five teams of three to fourjpeople. Each team was assigned a workshop 
session to plan cooperatively and later present in the presentation ses- 
sion. , The five .presentations were Active Listening, Behavior Feedback, 
Values Clarification, Role Playing, and Affective Integration.' " The prac- 
tice teams were given scheduled time to prepare their presentations." The 
participants appeared to use this time to full advantage. Many even met 
additionally -after' the close of formal workshop sessions in^he evening, y 
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The Panel. session- discussion included, tfte' Wlowtng-fsSues: worki'ng 
• witH the Cooperative Educational Service Agencies . (CE$fcfTStaf * develop- 
ment procedure.**, -guideline* for Ce*am pol^ies,. aria* c6arg&g>for.^rvices:. 
The guidelines were' written by the hifp Skiiia program .dtfectSr 'io help 
teams choose- cWa&ators, team memhers f an#»c<Jnduct training workshops. 
-Tbfe guiiflilinep were_ distributed to all workshop participants. 
^ The. mini-workshop' presentations were given during^most of the second 
day. Participants who were not presenting and the workshop leaders 
provided constructive feedback .to the practice teams. 

The evaluation session and the general session were combined. The 
general session provided a wrap-up o-f all .workshop, activities. The eval- 
uation session was used to fill out questionnaires assessing the quality 
and effectiveness of. the follow-up workshop to discuss the results of the 
initial workshop evaluation and to discuss the results of the Consumer 
Evaluation Panel session. ' 

. Twenty-three of' the 38 workshop participants completed the evaluation 
forms. Table III-6, contains the tabulated results of the evaluation ques- 
tionnaires. The questionnaire contained three . sections : attainment of 
workshop objectives, techniques, and evaluating the total experience. 

There were seven workshop objectives. Participants -Here asked to 
indicate how .well each objective was attained. The scale ranged from 5> 
(very successful) to 1 (very unsuccessful)/ All the mean ratings were 

a. ' 4 

around 4.0, which indicates that the objectives were attained. 
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Table IXI-6 



Results of -the Evaluation of the 
Novem ber 1978 Follow-Up Workshop 



Topic 

Attainment of 
Workshop Objectives 

1. To increase trainer confidence in 
ability to conduct Life Skills* ' 
teacher -training workshops. w 

2. To Increase trainer personal knowl- 
edge and skill in Life Skills 

* strategies through leading simu- 
lated practice sessions. 

3. To imcrease trainer ability to anti- 
cipate and handle common problems in 
conducting the teacher training work- 
shop . . ' 

v 

4. To enhance traiher ability to work 
in a -team relationship. t 

5. To increase trainer's knowledge of 
the procedure for offering teacher 
training wprKshop for certification 
renewal credit. 

6. To acquaint trainer with the Cooper- 
ative Educational Service Agencies. 



7. To acquaint trainer with the policy 
for bringing new~members into the 
♦ training team. ' — 



Mean Ratings 

(5 3 Very successful... 
1 = Very unsuccessful) 

4.30 



4.22 



4.00 



4.17 • 



3.78 



V 



3.87 



4.22 



- 1 f 



V- 



4 ■ * 
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TAle lil-6 (cont. ) 



Topic 



. ^ Teaching Techniques 

1. Problem Solving Session 

f 

2. Panel Discussion 



Practice Sessions 

(Preparation & Organization) 

Mini-Training Presentations: 

a. Listening for Feeling 

b. Behavior Feedback 

£. Values Clarification 

d. Rol^ Playing 

e. Affective Integration 

5. Handouts. 



Total Experience 

1. Hbw do you feel about -the work- 
shop? 

2. To what extent was the workshop 
successfu l 7 in m eeting your 'expec- 

' tat ions? 

3. How satisfied were you with the 
opportunity for participation?* 



Mean Ratings 

= Very effective... 
1 - Very ineffective) 

4.00 

3.65 



^48 



* 4.70 
4.41 

, 4.36 
4.50 



_AJU8L 
4.05 



(5 = Very pleased. . . 
<*4 ~ Very displeased) 

4.57 



4.39 



4.70 



• \ 

o 
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A consideration of £he ratings of the techniques employed to obtain 

* * " * 

the objectives indicates. that the ^respondents ielt the techniques were 

all effective. The only technique with a mean rating .below 4.0 was the 

panel discussion,, and even this was, within th^ "somewhat successful" 

interval £3.5-4*4) . ' 

* ' * x 

The final section of the evaluation^ session was a set of ques- 
tions to be answered by participants for the purpose of evaluating the 

x# * ?- . *^ 

total woTK&KKpV* The 'mean Ratings; for tte questions iff 5 this section ife- 
dicated"the following: - •< ."-"'*<»'* '• \ '• • " 

***** » 

% , • Participants were very pleased with the workshop. 

• The workshop was successful in meeting participant expecta- 
tions . 



• Those attending were satisfied with the opportunity f<jr 
participation. 1 * 

In summary, analysis of the evaluation results indicated that the 

.-workshop objectives were successfully attained, the techniques used in 

achieving these objectives were Very ^helpful, and the foilow-up workshop 

* ■ » ■» 

was successful in. responding to feedback^ rom the initial workshop,. 

March 4979 Workshop . A statewide meeting .of Life Skills trainers 

*as held on Marofr 12-13, 1979 at the Georgia Center for Continuing |duca- ' 

tion. A total of 45 individuals attended the meeting including 36 work-^ 

shop participants, 7 workshop leaders, and two' RBS evaluators. The 

workshop was coordinated by John Swisher, an RBS staff associate, and 

Xenia Wiggins of the Georgia' Department of ^^an Resources. The meeting's " 

main 'topic was affective integration. Th'eformafc of the workshop included • 
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m general sessions and sma^l group sessions? For the small group sessions, 
the participants broke down intb three ^groups of approximately 15 members 
each. , * , * 

The Agenda for the two days involved six major activities: (1) an 

^ V • 

introduction to the^wprkshop; '(£) small group problem solving sessions 6 

iji which participants who have 'held .workshops in the past presented prob- 
lems^whifch havfe # occurred and discussed ways of solvijig them; (3) affective 
integration — a* group session which stressed ways iti tihich' trainers could 
communicate- to teachers the importance of integrating Life Skills into 
their classrooms; (4) creative ways to affective 'isitegrat ion—small group 
sessions i^ which lesson plans and techniques were discussed; (5)^ group* 
p*esep|apions on ^fe^fveT^gratibn^nd. (6) a wrap-up/evaluation "in - 7 
which future activities occurring ^Ln the Life Skills program were dis- , * - 
cugsed and in which participants evaluated the present workshop. 

The results of the wrap-up/«valuation in which a total of 19 parti- 
cipants took part showed the following: 

• The workshop was successful in meeting its six objectives. 
On a* scale from 1.00 (very unsuccessful) to 5.00 (very 
successful), participants rated all six worksh'op objectives 
•equal to or greater than 4.00. 

• The effectiveness arid usefulness of the six workshop tech- 
niques were rated by participants. The scale was £rom 1.00 
(very Ineffective) to 5.00 (very effective) with 3.00 repre- 
senting an uncertain reasons?. The six means ranged from 
3.22 for the techniques demonstrated during the "Introduc- 
tion to the Workshop" to a 4.17 for the techniques employed 
during the "Sm&Ll Group Session on Affective Integration." 

• Workshop participants_were satisfied with the opportunity / 
- for participation (X - 4.39) . / / 




111-42 



• The^workshop was_rathei? successful in meeting participants 1 
. expectations * (X - 3*53). 

* • <a 

f The mean response for how participants generally felt about 
the , workshop was 3.61, which was in the "pleased 11 range 
'(3.50-4.40). * * 

January 1979 Kcrkshop . In addition to the State-Wide Meeting of 

LifB Skills Trainers held in March 1979, two other Training of Trainers 

i 

Workshops were. held: one in Griffin and one in Athens, Georgia. These 
were regional workshops. The three day Griffin workshop, held in January 
1979, was attended and observed by an RBS field evaluation specialist. 
At this workshop, two instruments were administered (the Life Skills for 
Mental Health Opinion Suryey and the Life Skills for Mental Health Training 
Workshop Registration Form ) » data were collected, and an internal summary 
report written. Results of the workshop eyaluation, completed by 16 par- 
ticipants, are summarized below. 



• The workshop was found to be rather successful at attaining 
its objectives. On a scale of 1.00 to 5.00, from lowest to 
highest, the means fgji>tfhe seven objectives ranged from 
4.06 to 4.50.* 

• The teaching techniques employed in demonstrating the Life* 
Skills program weyfe found to be effective. The means for 
the five techniqyfes ranged from a low of 3.75 for lectures 
to about 4.50 for Skill practice exercises. 

• The content of the discussed topics was found to be rather 
informative. The means for the nine topics ranged fr^om a 
low of 3.86 fof*planning and facilitating Life Skills in the 
schools to a high of 4.80 for explaining affective ^integra- 
tion. 

• In evaluating the total workshop experience, participants 
were found to be very pleased with the workshop (X = 4.56), 
thought that the workshop was rather successful in meeting 
participant expectations (X - 4.44), and were very satisfied 
with the opportunity for participation (X = 4.75). 



j 
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Training Team Coordinator Interviews 



Telephone interviews with CMHC Life Skills coordinators in«twenty-* 
five centers were conducted. These interviews were designed to determine 



the- status of the Life Skills program training in 1979. The^d^Xowing 

7* 

questions were asked: 

• When was your staff trained in the Life Skills program? 
° • How many Life^Skills workshops have your staff conducted? 

• How many teachers and other adults have your staff trained? * 
!• .Does your staff have any future workshops planned? 

Results showe^ijlat 28 percent of the staffs had been trained in 1977,. 

,36 percent has been trained in J.978, and 32 percent were trained in 1 

Of the 25 CMHCs surveyed, 2^ percent had held one to five workshops and 

16 percent had conducted six to ten workshops. In these workshops, the 

total number of teachers and other adults^ trained ranged from 1*2 to 235. 

However, SA.percent of, the CMHC^ had trained no teachers or other adults. 

Regarding >plans for future workshops during the current school yeat, 

72 percent of theNQMIfCs had no future 'workshops planned, while the remain-. 

ing 28 percentAiad one or twa-worteh©ps~scheduled 

r- 

, CMHC Trainer Questionnaire * , ' 

In 197^9, the .Community Mental Health Questionnaire was mailed to all 

CMHC personnel who had trained people in the Life Skills program or who 

v , 

planned v^a^hold training sessions in the liear future. The purpose of the 

v H> - . 



survey was to determine the CMHC's level, of involvement in the Life 
Skills program and to assess whether the Life Skills program had enhanced 
interactions between the CMHC and other related 'community agencies. 

Responses were received from 22 CMHC trainers. ' Background informa- 
tion on the respondents indicated that the majority held coordinator 
positions for child and youth service programs. One-third of"\e respon- 
dents were trained for the Life Skills program in 1977, another third in 
1978, and the final third in 1979, At their centers, the number -af_other. * 
CMHC personnel trained in the Life Skills program ranged from one to five 
with an average of four new trainees. Most of these personnel were from 
yoyph or drug and alcohol "programs, the areas most closely linked with 
the Life Skills program,. 

Life Skills training teams ranged in size from one fo fifteen, but aver- 

aged about four. The level of activity for. these teams was relatively 

, low. Thirty-two percent had conducted net workshops; 32 percent had pre- • 

» 

sented one or two workshops per year; 23 percent gave th*ee to five work- f 

v 

* shQps per year, £jnd only 14 percent had' presented more than five workshops 
.per year. Thirty-eight percent of the respondents felt, the Life Skills 
program had increased referrals in their programs, but the remaining 62 
percent saw no effect. 1 , 

„ Table III-7 shows responses to a. number of questions on how the Life 
Skills program has affect.ed communication with other agencies. The find- 
ings show^that communication with the schools and the Georgia Department 
of Human Resources has increased 'substantially as a result of the Life 
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Skills program. Contact with othfer CMHCs and wfth district school boards 

also had increased since the Life Skills program began. ' . 

- * 'Table III-7 

Effect of the Life Skills Program on 
* Irtteragency Communications - 





Quest iotk> y * 

Has the Life Skills program af fee tied your CMHC 
communication or contacts with: 9 


Percent 




Yes/* 


No 




the schools?" v ' / 




16 




the Georgia Department, of Human Resources? ' ,y 


68 


32' 




other CMHCs? 


45 


55 




the district school board? ' 


45 


55 




other state level personnel? 


19 " 


81 



r — 

Training- of Teachers 

The Training of Teachers is a- second critical component to the 
implementation process in the Life Skills program. The success of the 
Training \>f Teachers Workshops in large measure determines the extent and 
quality of implementation of the program within the school classrooms. 

Numerous Trailing of_ Teachers . J^kshop_s .were coaductad„o.veLthe-'in 



itial year of- operation of the Life Skills program and during the evalua- 

» 

%ion study. These were convened throughout Georgia at varied times during 
the yea^r-. Field evaluation specialists were not able 'to be present at all 
of the teacher workshops, iut did attend several of them. A workshop evalua- 

% t 

tion questionnaire paralleling ,that ot the Training of Trainers Evaluation 

' \ ~ 

Questionnaire was developed for use with the Training of Teachers evalua- 

tion* 'The Mental, Health 'Opinion Survey fras also used." Results of 1 - 
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evaluations .of individual workshops indicated a range of effectiveness, 
with mo^t tending to fall between the successful/very successful, rating 
categories insofar as meeting workshop' objectives is concerned. The 

o 

general observation seemed to b.e that teachers rated the Training 

of Teachers Workshops higher than the trainers* rated the Training 

of Trainers Workshops, due chiefly to -the fact that the material covered 

in the workshops tended to be much more unfamiliar, to the teachers than 

to the trainers, * 

In this .section, a compilation of information relating to oartici- 
pants of the Training of Teachers Workshops is presented, together with 
the results of a follow-up survey of trained teachers and an activities- 
^log assessing use of activities and strategies l$arn,ed through' the work- 
shops. '* * 

-j 

-frainjng of Teachers Worksho ps 

Between 1977 and 1979, approximately 1,000 teachfers and 200 other' 
adults were trained in Life Skills at ten different community* mental ' 
health centers in Georgia. The available information. about the teachers 
trained varies. Although some CMHC teams did not record the teachers 1 
names, most had lists of both names and schools, some tfad registration 
forms, and some had both registration and evaluation forms in addition to 
mental^health questionnaires. 

The Life Skills team coordinators -were asked to send all available 
i^gistration forms, evaluation forms, and mental health questionnaires to 
the Life Skills Evaluation Project, Atlanta office. .The profile was based 
\ ' 
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on information from 55 registration forms and 76 evaluation forms. 
•"Ttfcluded in the registration forms were address, age, and educational I f 
level of participants, grade level taugljt, years of professional expect 
ence, and previous training (and date trained) in activities similar to 
Life Skills (e.g., values clarification, PET, eta.). Only the grade 
level taught and the yearssof teaching experience were requested on the - 
evaluation form. In an effort to increase the return rate of forms to 
the Atlanta office, Team Coordinator^ were jnailed additional forms with 
a request for extra follow-up efforts. Vok completed profile is presented 
in Table III-8 on the following pages. * , 

Foll6w-Up Survey of Teachers • . • 

\ 

.A questionnaire was developed and completed to survey teachers after 
their attendance at; Life Skills Training of Teachers Workshops. This 
questionnaire, the Life Skills for Mental Health Follow-Up Survey on - ' 

Teacher Training Workshops , consists of multiple-choice question^, open- 
ended questions, and Likert-type response questions teee Appendix A ). * 
The purpose of the survey was to determine the workshop's effectiveness 
in giving teachers an understanding of the Life Skills program and its, 
implementation in the classroom. The survey itself was designed to elicit 
three types of information: the kind and frequency of use of Life Skills 
activities in the classroom; the attitude change in students as perceived 
by their teacher as a result of "L ife Skills exposure; and the usefulness 
of the ^acher training workshop. 
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Table III-8 

Profile of Participants in Life/£kills 
Training of Teachers Workshops/ 1977-1979 



Variable 



Profession 



1 



Age* 



Education 
Level* 



Years 

Experience* 

Previous Train- 
ing in Activi- 
ties Similar 
to Life Skills 



Categories 

Teachers 

K-3 

4-6 

7-9 

10-12 

Adults 

Other Professionals 

Counselor 

Health Department 

• Special Education 
Media Specialists 

• Music 
Reading 

^Principal 
Speech Therapist 

Un\ler 25 
25-34 
35-45 
Over 45 



B.A. 
M.A. 

Ph.D. or Ed.D. 
Other , "\ 



Values Clarification 
Role Playing 
.PET/TET 

Cdtamunication Skills 
Assertiveness Training 
Other 

No Previous Training 



Frequency 

77 

26 
23 
12 
14 

.2 

54 

26 
. 9 
9 ' 
-4 
« 2 
»2 . 
1 

• 1 

4 
19' 
6 
1 

23 



0 

9 . 

Range : 
Mean : 

7 

8 

5 
10 

5 

3 
26 



Percent of 
Total • 

59 

20 
18 
9 

11 « 
» 1 

41 

' 20 
7 
T 
3 
1 
1 
1 

• 1 

13 , 
63 
20 
3 



58 

-20- 
0 
22 



1-22 
6.31 



Years 
Years 

11 

-33- 

8 
16 
8 
5 

41 . 



*Not requested on all forms. 
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The training of teachers follow*-up survey was* conducted .during 
April and May, 1979. Follow-up questionnaires were mailed ou£ to all * . 
teachers^ wlp had attended a Life SkiUs for Mental Health Training of 
Teachers Workshop. The results of this, survey are included in Appendix A, 

The documentation of the follow-up survey on the teacher training 
workshop involved reporting the* results obtained* from '60 teachers in 23 1 
schools. The teaching experience of *the { teachers ranged from 2 to 33 
years, with a iiean of 10.5 years. The methods used to report responses 
were direct percentages, mean percentages, mean ratings, ancf actual com- 
ments from the teachers. 

Data from the teacher follow-up survey showed positive results. The 
majority of teachers reported that they were employing *the Life Skills 
activities once a week or more, that they were using the activities in a 
variety of ways,, and thai they felt;, the Life Skills activities were justT 
as effective or more effective thkn^iLilar. mental health' materials. , 

m 

Responses -indicated an overall increase in the teachers' use of the four 

- * • f 

affective, strategies (Listening for Feeling, Behavior Feedback,* Values 

Clarification, and Role Playing) ,* and positive changes in student be- 

havidrs related to- the Life° Skills activities and strategies. 

In evaluating the^orkshop, .respondents^ generally ^felt that the 

objectives had been successfully attained but that more attention should 

be given to^ helping participant? in integrating Life Skills activities 

and strategies with lesson plans and classroom content. 
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Activity Loj>s * ' " ''' . # 

^ An Activity Log wa§ developed by the program evaluation team to 
sample the extent to which the training received by teachers through th6 
Training of Teachers Workshops was transferred to .utilization of strate- 
gies* and activities in the classroom. . 

Activity Logs were sent oik periodically to all trained teachers. 1 
On th4 Activity Logs, the teach irs w£r€* requested 'to Veep a record o£ the 
Life Skills activities they.usejd in the classroom, the manner in which 
the activities were employed, the time spent on each activity, and the 
class reaction to the activity. A sample of teachers was asked to maintain 
this log for a period of weeks^ then to mail it to "the RBS .field specialist 
or r^urn it t.o the R$S tester at the time of posttesting. . Information 

gathered from the Activity Logs was not only used to document classroom 

' % 

use of Life Skills strategies and activities^, but was also used in refining 
the d^ta analysis plan for teachef^and student outcomes. 



A sample Activity, 



is shown In Table III-9. The Table indicates 



that data requested on teachers were among other things: the level 

of the Life Skills Activity Guide being used; the activity name or number 
used; the size of the group taking part in the activity; whether this was 
the first time they used the activity; How the activity was used; the amount 
of time spent on the activity; and the class reaction to the activity. 

An analysis of the sample of Activity I^gg returned is presented in 
Table III r 10. Results are shown fop-the sample stratified by the teaching * 
level associated with different levels of the Guides.' As can be seen by 
the findings presented, the majority of teachers across all grades utilized 
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srraL^es m tn P y^ d cui:::o m ab ° Ve ' Ci . rC ' e reSP ° nSe th3t b . 6St deSCrib " the freqUenCy With Which > u used each ° f ^ f °"°-9 



Li stening fpr Feel ing 
Behavior Feedback 
Values Clarification 
Role Playing 



Dai ly 
Dai 1 y 
Dai ly 
Dai ly 



Weekly 
Weekly 
Weekly 
Weekly 



Month,! y 
MonthVy 
Mont hi y 
Monthl y 



» 

it 

r 




• 






, Table III- 


9 * 






V 










AC t 


ivity tog for'Life Skills for Mental Health 


5-8, 9-lT 


12-U, 15-18 










Grade 


Leve 1 




School* 






Sub j ec t 


i 























> 

i 










*Ac t » v i : y Name 


Page 
No. 


Date 


Gro 


up Size 


(J ) 1 


First t Ime 
act i vi ty 

(Yes or No) 


Act i v ity Use 




V 

Tnme spent 
on act i vi ty 

(to npfl rp^ t 

5 minutes) 


* Class 


p eaction 




(ar>d . number , i f any) 

\ 


Whole 
Class 


Small 
Group 


I nd i v i j 
dua^ 


With other 
subject 
ma t te r 


As a sep- 
arate 
activity 


-At a teach- 
able < 
moment 


Very 
Pos i t i ve 


Very 
Negat i ve 




* 












• 






\ 




5 


3 2 1 






/ 




i 









* 


• 




* 


r 

5 <i 


3' 2 1 
























• 


5 *» 


3.2 1 


























5 ? <» 


3 2 1 


III 




















< 




5 <i 


3 2 I 


1 

• La 














\ 










5 ' k 


3.2 1 






















* 




5 ^ 


3 2.1- 


























5. \ 


3 2 1 


























5*32 1 


i 
























— 

5 * 


3 2 1 
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Table 111-10 



Summary of Sampl-e Responses to Activity Log 



Group 


Average No. 
of 

Activities 

Per 
1 eacner 


— t 1 


Group Size 


First Time 


Activitv Use 


Average 
Minutes 

Per 
Activity 


Average 
Rating 


Whole 
Class 


Small 
• ^jGroup 


1 

Individual 


Yes 


No , 


With, Other 
Subject 

Hatter 

•> 


Separate 
Activity 


Teachable 
Moment 


Lower 

Elementary 
(N - 9; 


X - *8,33 


94% 


ex - 


0% 




382 


12% 


82% 


6% 


X - 33 

min, 9 


\ 

X - 4,64 


Upper 
Elementary 
(N - 15). 


X - 


82% ' 


12% 


6% 


81% 


i9Z 


18% 


64% 


18% - 


X - 37,9 
min. 


X - 4,28 


Intermediate 
(N- 3; 


X- 6.25 


74% 


12% ' 


14% 


79X 


212 ' 


46% 


38% 


16% 


X - 37,4 
min. 


X - 4,32 • 


High, School 
(N - 13j 


X* 4.92 


85% 


♦8% 
1 

► 


ex ' . 


\ 

sex 


44% „ 
-1 1 — 


47% 


48% p 


«s 

5% 


X W 44 
mini * 


X- 3,97 



I* 



tOo 



10'6 



the activities in the Guides as whole class activities, devoted about 30-" 

* f 
40 minutes on'each activity, and received ve.ry favbra.ble class reactions: 

7 

Teachers, at the elementary levels tended to use the activities as separate 

v • ■ r 

aitti distinct from other classroom work, while intermediate and high schodl 
level teachers tended to integrate the Life Skills activities more With ' * 
other subject matter. being taught. 
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\ . 

TV. OUTCOME EVALUATION RESULTS 

N ' 

Results for both the- student outcome evaluation arid the teacher out- 

come evaluation are presented in this chapter. . * * 

N ' *. ' * * 

J Student Outcomes % 

/, 

Results of the student outcome evaluation have been organized accord- 

' y . . 

-ing to age group — Early Elementary, Upper Elementary, Intermediate, and 
High School. Within each of these agp groups, two majpr sets of analyses 
weire performed. First, repeated measures analyses of covariance were 
conducted to determine the effects of the treatment variable over time. 
Second, regression analyses were conducted to determine the contributions 



of pretest scores, treatment effect, se£7>i*d ethnicity in- predicting 
scores 'on the second posttest. -For.borth of thes^aafclysH, complete data 



for all three testings on each stu^nt were ne^ed. Thus, ^the matched 

sample discussed( in Chapter II wa/s used as the data base for the analyses, 
v . ( - / 

On the repeate^measures aj/alyses, pretest was used as a covariate,,, 
to adjust scores on posttest I and posttest If for comparison. Similarly, 
in the regression analyses, pretest was included as a predictor variable, 
since in many cases it accounted for a large amount of the variance in 
posttest II scores. However, primary interest in the regression analyses 
focused on the~\onti;ibution o£ sex, ethnicity, and treatment effect in 
predicting' scores on posttest II. Scores on posttest 1 were not included 
as predictor variables because of the potential problems of autocorrela- 
tion between scores on the pretest and on posttest I. 
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On all .analyses, a probability level of p < .10 was used -to determine 
significance. . ... 

► 

Early Elementary Results \ 

Four instruments were usdd to measure the behavior of early elemen- 
tary students. Table IV- 1 lists TTRfe^ instruments and the dependent vari- 
ables they were designed to measure. 



Table IV-1 

* Early Elementary Instruments 
and Dependent Variables 



Instruments 


\ 1 

Dependent Variables 


Myself 


...... 7 1 

Self-Concept 


,My Class 


Interpersonal Skills' 


About My Class 

^Disruptive Behavior 
Scale 


Classroom Climate 


Disruptive Behavior 


J 



Two other dependent variables included in the upper age- groups, were not 
addressed at the early elementary letfel. Attitudes toward school were 
not /tneasured at the^early elementary level because of the difficulties 
involved in (1) .creating a survey which would parallel the attitude meas- 
ures used in the upper age groups, and (2) developing a* survey of -this 
type that early elementary students coulcj read and understand. In^addi- 
tion, no drug- surveys were administered to the early elementary students, 
'in order to prevent. premature exposure to drug-related information. 



% - 



IV-2 - 
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Findings. Data for each of the first three dependent variables 
were analyzed employing a repeated measures analysis of covariance, using 
pretest scores as the covariate. Two main effects were of interest, 
treatment effect (Life Skills students versus control students) and per- 
formance over" time (scores on Posttest I vs. scores on Posttest II). Re- 
sults are presented in Table IV-2. * ^ 

The repealed measures analyses revealed two significant findings*. 
On the self concept measure, Myself , the treatment main effect wa£ signi- 
ficant, showing that Life Skills students consistently evidenced more 
positive self images than dfd control students. On 'interpersonal rela- 
tionships, as measured by My Class , Life Skills and control students" 
scored* at Approximately the same levels, however both groups showed sig- 
nificant positive changes over time by increasing their scores from the 
firat' posttest to the second posttest. 

r ■ ■ 

A sfecond set of' analyses on the dependent variables was conducted 
us ing^ regression techniques to determine the contributions of pretest 
score, treatment, ethnicity, and sex in predicting scores on the second 
posttest. Scores on the firs t -posttest were not included as one of the' 
predictor variables, due; to potential problems of autocorrelation. Re- 
sults of these analyses for the early elementary level on the first three 
dependent variables are presented/in Table, IV-3. No significant contribu- 
tion variables were found ia the early elementary regression analyses for 
Myself , My C^ass , or About My. Class . 
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Table IV- 2 



/ 



Findings on the Repeated Measures ^ * 
Analyses of Covariance tor Early Elementary Data 





• 


> 






• 








t 








Dependent x 
' Variables 


Group 


K '* 


Pretest 

> 


Post I * 


Post II 


Main - 
Effects 


I 


£ 


Significance 


Njyself 

TSelf Conc*R£) 


LS > 
C 


166 
100 * 


144.72 
145.10 


(SD-10.09) 
(SD- 9.76) 


143.93 
141.62 


(SD-10.57) 
(SD-10,53) 


142.34 
140.61 


(SD-11.06) 
(SD-10.05) 


£ vs. C 
I vs. II 


4.696 
2.351 


.031 
.126 


* 

NS 


My Class 


. IS ' 


168 


134.24 


(SD-11.62). 


136.72 


(SD-12.81) 


140.02 


(SD-12\81) 


E vs. C 


.000 


.987 


NS ' • 


(Interpersonal 
Skills) 


c 


102 

* 


133.42 


(SD-11.77) 

i 


135.92 


(SD-12.32) 


140.24 


(SD-14.13) 


i vs. ir 


7.088 


.000 


** 




























About My Class 
(Classroom* 
Climate) 


c 


.165 
97 


182.33 
X90.99 


(SD-28.44) 
(SD-24.87) 


189. U 
194.^7 


(SD-31.26) 
(SD-26.33) 


' 191.36 
195.09 


(SD-28.16) 
(SD-28.84) 


E V87 C 
I VS. II 


.819 
,297 


.366 
.586 


j NS 
NS 


♦Significant at t£e p < 


.05 level. 


< 


4 








> 










♦♦Significant at 


the p 


.005 level. 























Table IV-3 



Results of Early Elementary Regression Analyses 

£ / 



Dependent 
Variables 


Instruments 


Independent 
Variables 


Beta 


F 




Significance 
NS 


Self Concept 


Myself/ 


Pretest 


-.002 


.002 


.969 




V ' / 


Treatment 


-.081 


1.786 


.18$ 


NS 


- 




Sex ♦ 


.096 


2.401 


.122 


NS 


* 


/ 

/ 


Ethnicity 

• 


.046 


.547 


.460 


NS 


Interpersonal 
Skills » 


My yClass 


Pretest 
Treatment 


.014 
-.045 


.049 
.552 


.8*24 
.458 


NS 
NS 






Sex 


-.067 


1.151 


.284 


NS 


>• 




Ethnicity 


-.082 


1.749 


.187 


NS 


Classroom 
Climate 


About My 
Class 


Pretest 
Treatment 


-.010 
-.017 


.027 
.077 

« 


.870 
.782 


NS 

• NS 






Sex 


-.042 


.464 


.496 


NS 




• 


Ethnicity 


-.082 


1.755 


.•186 


y ns 



The fourth dependent- variable for the early elementary level was 

disruptive behavior. This variable was measured by, teacher repbrt of 

changes in disruptive behavior for individual students, recorded on the 

Disruptive Behavior Scale . The changes were measured for the time period 

from Fall 1979 to Spring 1980, that is, from pretest* to first posttest. 

^Data were analyzed using a student's t test. Results are presented in 

/ 

Table IV- 4. 

Table IV-4 





' on 


the Disruptive 


Behavior 


Scale 




Group 


N 


Mean 


S.D. 






LS 


407 


3.42 


.837 


* 3.276 


.005 


Control 


197 » 


3.20* 


.724 







Life Skills students were rated as having evidenc^J significantly greater 
changes toward less disruptive behavior than the control group. 

Discussion . At the early elementary level, the analyses showed two 
significant effects of the Life Skills program. First* Life Skills stu- 
dents showed consistently more positive self-concepts after tl^e introduce * 
tion of the Life Skills program than did the control students. Second, 
the Life Skills students showed significantly greater changes toward less 
disruptive behavior than did their control -counterparts. 

These findings are encouraging for the Life Skills program at the 
early levels. If students develop a positive self image during their 

* c 

4 
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early years, this may later impact on many areas, possibly including 
those related to academic achievement and drug behaviors. The change 
toward less disruptive behaviors in the Life Skills, students also may be 
linked to their more positive self .concepts . » 

The analyses revealed one other noteworthy finding: the significant 
increase, for both groups, in scores on My Class from the first posttest 
to the second posttest. Since both groups evidenced similar increases on 
this variable of interpersonal skills, a likely explanation may be the 
maturational change in social skills during the Wly elementary years. ' 

Upper Elementary Results — * 

The attitudes and behaviors of upper elementary students were meas- 
ured using a set of six instruments. In Table.JV-5, these instruments 
and the corresponding dependent variables are presented. 

Tablfe IV- 5 

0 

• *** s 

Upper$Elemtentary Instruments ancTbependent Variables 



Ins-trumefits 

My Class 
School L ife 

r- 

Abftut My Class 
Attitude* Toward School 
My Opinion 

Dru£Attitudes 

Lifetime. Use 

Recent Use - 
Disruptive B<fhavlo^_Scale- 



Depehdent Variables ' 
Self Concept . 
Interpersonal Skitls 
Classroom Climate 
School Attitudes ■ 5 

Drug-Related Behaviors 
Attitudes Toward Drug^Jse 

Frequency of Lifetime Use, 
4 Frequency of Recent Use 

Disruptive Behavior 



IV-7 
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Finding^ Dataon all measures except the Disruptive Behavior Scale 
were analyzed using repeated measures analyses of covariance and regres- 
sion techniques. Results of t}ie rtpeated measures analyses are presented 
in Table IVt6. • 

The repeated measures analyses revealed several "Ibignif icant findings, 
all on the main effect concerning differences in scores for posttest I 
and posttest II. On the se^f* con^pt measure, Myself , both groups showed 
significant decreases from posttest I to posttest II. However,, on life- 
time drug use and recent drug use, defined for the upper elementary group 
as use of alcohol, cigarettes, or marijuana, both groups reported signi- 
f icant increases from posttest I to posttest II. More specific breakdowns 
on levels of reported drug usage for upper elementary students are pre- 

sented in Table IV-7. „ • * r ' - u 

m \ 

The second set of ^.analysgs on the upper elementary da^a was con- 

ducted using regression techniques. Tabfe IV-8 provides the findings 

from these analyses. * a 

The regression analyses showed some interesting 'results. *\ Sex 

f *• ' / . 

• . • .* .t . ' 

proved* to be^a significant predictor for school attitude,; drug attitudes, 

and lifetime drug use. Femalea were more positive than males in their 

attitudes toward school, they were less tolerant* in theiX^attitudes 

toward drugs, and they reported .lower* lifetime us^ of drugs. " 

Ethnicity also was a significant predictor of attitudes toward schopl and 

of interpersonal skills. Nanwhitek had more positive attitudes toward 

school than whites,, .but whites had higher predicted scores on measures of 
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/ Table IV-6 3 

Findings 7 on the Repeated Measures Analyses^ 
w cjf Covariance for Upper Elementary, Data 



H 

f 

vo 



Instruments 



Myself 
(Self Con- 
cept) 

School life • 
(Interper- 
sonal Skills) 

About My Cl«as8 



(Class room 
Cliaate) 

I 

Attitude 



Toward School 
(School Atti- 
tudes) 

My Opinion 
(Drug Attitude^) 



My Opinion 
(Lifetime Use) 

My Opinion 
(Recent Use) 



Group * N Pretest 

LS 308 j 334.37 (SD-32.39) 

C 98 335.95 (SD-32.&5) 

LS 306 344.30 (SD-53.19) 

C 96 ( 334.23 (SD-48.86) 

LS 307 322. C9 (SD-52.07) 

C * 97 320.78 (SD-48.38) 

LS 307 300.52 (SD-45.94) 

C 98 292.82 (SD-53.38) 



LS' 291 126.48 (SD-29.Q6T 

C • 93 119.69. (SD-27.04) 

LS ^302 ' 143.81 (SD*62.43) 

C 94 132.06 (SD-55.64) 

LS 302 144^59 (SD-66.87) 

C ' 93 131.52 QsD-54. 59) 




Post I 

335.01 (SD-34.22) 
338.05 (SD-34.45) 

324.29 (SD-60.04) 
319.17 (SD«60.43)* 

315.84 (SD-56.45) 
319.29 (SD-56.55) 

291.26 (SD-50.27) 
285.98 (SD-54.22) 



132.51 (SD-29.43) 
125.25 (SD-28.38) 

158.25 (SD-69.72) 
148.02 (SD-57.98) 

144.59 ^SD-66.87) 

131.52 (SD-54.58) 



Post II 

331.11 (SD-36.62) 
330.38 (SD-40.23) 

329^9 (SD-61.35) 
326.28:<Sto&r.45) 

31£.02 (SD-55.37J 
312.58 (SD-52.47) 

287.01 (SD-52.86) 
291^78 (SD-50^63) 

132.89 (SD-35.52) 
127.53 (SD^35.45) 

164.55 (SD-78.64) 
'153.83 (SDn74.83) 

164.66 (5D-78.58) 
153.33 (SD-75.09) 



Main Effect 
i 

E vs*T>€ 
I vs. II 



E vs. C 
I vs. II 



E vs. C 

I vs. II 

E vs. C. 

I vs. II 



.Of 5 
5.107 



E va* C .046 

I vs. II 2.051 

E vs. C .239 

I vs. II 1.760 



.810 
'.006 



1.922 
. .384 

.177 
3*158 



E vs. C ^ .162 
I vs! II 24.746 



£ 
.902 
.024- 

.830 
.153 

.625 
.185 

.369 
.929 



.166 
.536 

.675 
.076 

.688 
,000 



Significance 

NS 
* 



NS 
NS 

NT 
NS 

NS 
NS 

NS 
NS 

NS 
+ 

NS 
** 



+ Significant at the p < .10 level. 
'* Significant at the p < .05 level. 
** Significant at the p < ,005 level. 
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Table IV-7 



Reprfrt^ Drug Use for Upper Eleirfentary Students, 
Rgcorded as Percentages of Total - — 



Recent Use 



Pretest 



During the last four 
weeks, |iow often have 




J 


LS (N=583) 






=-V— 


Qontrol 


(N'220) 




you : j 

j 


Never 


1-2 
times^ 


3-10 
times 


11-20 
times 


21. or more 
times 


Never 


1-2 
times 


3-10 
times 


11-20 
times 


, 21 or more 
, . times 


smdkled cigarettes? 


91.1. 


5.3 


.9 


.9 


1.0 . 


93.3 


4.9 


.4 


.4 


.9 


drunk alcohol? 

1 


78.9 


17.9 


1.4 


.3 


1.5 


80.5 


15.4 


. 2.3- 


.9 


* 


smoked marijuana? 


96.9 


2.0 


.3 


.5 


\ "-3 


96.8 . 


1.8 


.5 


.9 


.0 

#■ 


. » 
Lifetime Use 










1 






> 






Have you ever: 








« 












- ' 


smqked a cigarette? 


69.4 


22.7 P 


3A 


1.0 


3.4 


73.0 


18.9 


4.5 


1.4 


■ 2 ' 3 . 


drunk alcohol? ' ' 

i 


' 46.1 ' 


37.2 


10.6 


2.1 


3.9 


60.6 


27.1 


7.2 


' i.a 


3.2 * 


v smoked marijuana? 


92.8 


5.1 


' .5 


1.0 


.5 e 


94.1 


3.6 


.5 


f 

:-5 


" ; 1.4 
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liable IV-7 (cont.) 



i 



t 

Recent Use ^ % 


5 — 9 — ^— 

Post I 


< 


During the last four 
week§, how often have 


LS (N-529) 


- 




Control, (N- 


-205) 






you : 


Never 


1-2 

times . • 


3-10 
times 


11-20 
times ■ 


21 or more 
times 


wever 


1-2 
times 


3-10 
times 


11-20 
times 


21 or more 
times 




^ smoked cigarettes? 


92*. 2 


' 4.9 


1.1 


.6 


1.1. 
• * 


89.8 


5-9 . 


2.4 


.5 


1.5 




s _ — ——<lrunk alcohol? ° . 

• r 


76.2 
• 


T6.4 


4.9 


.6 


1.9 


83.4 * 


10.7 


3.4 


1.5 


1.0 




I f 

» smbked marijuana? 


96.8 


2.1.. 




.2 




97.0 . 


1.0 


1.0 • 


.5 


.5 




Lifetime Use 








<> 
















Have you ever : 




















-*«. 




smoked a cigarette? 


58.2 


28.4 


6.2. 


2.5 


4.7 


65. % 


23.9 


5.4 


1.5 


3.9 




drunk alcohol?* 


37.8 


34.6 


14.9 


5.1 


.7.6 


44.1 


38.2 


9.3 


4.4 


3.9 




smoked marijuana? ' 


93.6 


• 3v4 


1.5 


J .4 


1.1 


94.1 


* 3.9 


.5 


1.0 


.5 
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* 

9 


k 

* 

* * 


° a <■ 


• 


f 
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Table IV- 


-7 (cont.) 


S 






r 




• 




V 








t 




- 


# 




Recent Use 










Post II 


• 








During the last four 
weeks, how often have 






LS 


(N*447) 




- 




Control 


(N=130) 


* 


you : 


Never 


A 

/rimes 


3-10 11-20 
times times 


21 or more 
s times 


liCV CI 


1-2 
times 


• 3-10 
times 


11-20 
times 


21 or more' 
, times 


smoked cigarettes? 


"86.1 


( 7 * 2 


4.0 


.9 '' 


1.8 


91.5 


5.4, 


2.3 
1.6 


.8 


_ ^0 . 


drunk alcohol? 


76.4 




6.2 


•4 


-A 


86.0 


10.9 


.0 


1.6 


- smoked marijuana^ 


95.1 


3.3 


..9 


.4 




AC/ 

95.4 , 


3.1 


r 

*~ -8 


.'8 


.0 


Lifetime Use 




■ ;_\ 




/ 














• 

Have yo\x ever: ' ; 






\ 
















' SDjoked a cigarette? 


55.0 


27.7 


'7.8 


2.7 


1 

6.7 


73.1 


16.2 


6.2 


, 2.3 


2.3 


drunk alcohol? 


43.2 


33.8 


11.6 


3.8 


7.6 


50.0 


T * 


o • J 


3.1 


6.2 


smoked marijuana? > 


90.9 


.5.8 


2.0 


1.1 


.2 


93.1 


2.3 


2.3 


.0 


2.3 












/ 

• 


> • 








i 
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Table IV-8 



Results of Upper Elementary Regression Analyses 



Dependent 
Variables 

Self Concept 



Interpersonal 
Skills 



Classroom Climate 



< 
i 

to 



School Attitudes 



Drug Attitudes 



Lifetime Use 



Instruments 
Myself 

School Life 



Independent 



About Your 
Class 



Altitude Toward 
School 

My Opinion 



' My Opinion 



j » 



Variables 


Beta 


F ' 


P 


a J. C LCO L 


. U /0 


1 . j06 


. 130 


Treatment 


-.008 


.025 


.873 


Sex 


-.012 


.058 


.810 


Ethnicity 


-.033 


.427 


.514 


r l ti t.tJo t. 


Tin 

• JLJLU 


* 

4. 803 


.029 


Treatment 


— 046 


.889 


.346 


Sex 


.008 


.030 


.864 


Ethnicity 


-.114 


5.205 


.023 


Pro t* oc t* 

Fire Leo t. 


1 OO 


Q.039 


.014- 


Treatment 


-.017 


.118 


.731 


Sex 


.028 


' . .330' 


• .566 


Ethnicity 


.021 


.169 


.681 


"D t* Q O ♦* 

rictcot . 


000 
• LLL 


21.017 


.000 


Treatment 


.050 


1.133 


.288. 


Sex 


.154 


10.770 


.001 


Ethnicity 


-.158' 


10.739 


.001 


Pretest 


*- .,008 


•024 r 


< 

.877 


Treatment 


— :043 


.768 


.381 


^tx 


• -.204' 


17.494 


.000 


Ethnicity 


.024 


.247 


.620 


Pretest 


1176 


13.006 


.000 


Treatment 


-.049 


1.062 


. .303 


Sex 


-.182 


13.989 


.000 


Ethnicity 


s .0-74 


2.400 


.122 



^Significant at the 

^^Significant at the 
% 



p < .05 level, 
p < .005 level; 



Significance 



NS 
NS. 
NS 

' * 
NS 
NS 
* 

* 
NS 
NS 
NS 

** 

NS 
** 
** 

NS 
NS 
** 

NS 

** 

NS 
** 

NS 
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interpersonal skills than nonwhites. Finally, pretext score was signifi- 
cant in predicting 'the second post test score on four measures: School 
Life , About Your Class , Attitude Toward School , and Lifetime Drug Use . 

* , The f fnal dependent var iable for the .upper elemer^tary level was dis- 
ruptive behavior. Measurements of this variable proceeded exactly as 
those described for the early efementa^y level. Table IV-9 contains the 

findings -on this variable t 

j * 

Table IV-9 



Upper Elementary Results on the 
Disruptive Behavior Scale 



Group 


N 


Mean 


S.D. (' t 


£ 


LS 


524 


3.31 


*772 3.721 


.005 


C 


188 


" 3.10 


.658 





As with early elementary students, \ipper elementary students were 
rated as having evidenced significantl4greater changes toward less dis- 
ruptive behavior than the comparable control group, < 

Discussion . For students, at the upper elementary level, results of 
the repekted measures analyses revealed a significant decrease in 
self concept scores from the firsts posttest to the second posttest. 
SJpfce the first posttest was administered in' Spring 1979, near the end 
of the school year, and the second posttest was administered near the 
middle of the school year in Winter 1980, one might attempt to explain 
this decrease in scores by the difference in the time of school year at 
which the tests were administered. That is, students may have been more 
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positive about themselves at the end of the school year than in the 
middle. However, the plausibility 'of t;his explanation is ruled out by 
the examination of self concept scores at other levels. A quick review 
£hows that the phenomenon is unique to the upper elementary levels. Thus, 
the observed results on self concept at the upper elemerttary level may 
be a function of some yet unidentified variable. 

Findings for the repeated measures analyses of recent use of cig- 

. \ ' 

arettes, alcohol, and marijuana showed significant increases for both 

> 

grfcups in recent use fronf the first pos~ttest~~to"~the second ~posftest^ 
These results corroborate the findings of other studies showing the 
period from fifth to sixth grade to be a prime time for experimentation 
with cigarettes, alcohol, and marijuana. 

In the regression analyses, sex and ethnicity both contributed sig- 
nificantly in predicting performance on a number of dependent variables. 
Upper elementary males' had ^significantly higher predicted Scores tha$ • 
females on their tolerance in drug attitudes and in their lifetime use 
of alcphol, cigarettes, and marijuana. This difference in predicted 
scoMs may be due to a consistent difference between ^he sexes in use 
and\^titudes across time, or just to a difference in the relative time of 
experimentation for males and females. Later examination of results for 
intermediate and high school students may help to provide some further 
input for explaining thisNfeehavior . Males also had significantly less 
positive attitudes toward school than females.' 

Ethnicity was a* significant factor in predicting attitudes toward 
school and interpersonal relations scores. On attitudes toward school, 
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predictions of scores for nonwhites were significantly higher than for 
whites, but. on interpersonal skills, whites had higher predicted Scores 
than nonwhites. Later examination of results on these variables at the 
intermediate and high school levels should provide further insist into 
the importance of tnese trends. 

On the disruptive behavio^variable, Life Skills students were rated' 

« 

as showing significantly more changes toward* less disruptive bejiavior 
than the^^trol students. For both the ea^ly elementary and the upper 



* ""elementary groups," positive changes toward less disruptive behavior 
seem to be linked to the implementation of the Life Skills program. 



Intermediate Results 

The attitudes and behaviors of the intermediate level students were 



measured using a set of six instruments. These measures and the corre- 



sponding dependent variables are presented in Table IV- 10. 

r 

Table IV-10 . '# 
Intermediate Instruments and Dependent Variables 



Instruments 

Myself 

School Life 

About My Class o 

Attitude Toward School 

My" Opinion on Dpigs and 
Alcohol 

Drug Attitudes 

Lifetime Use . * . 

Recent Use 

Disruptive Behavior Scale 



J 



Dependent Variables 

Self Concept 
Interpersonal Skills 
Classroom Climate 
School Attitudes 

Drug-Related Behaviors 

i- 

Attitudes Toward Drug Use 
Frequency of Lifetime Use 
Frequency of Recent Use 
Disruptive Behavior 



IV-T6- 



Findings. Repeated measures analyses wVre performed on all data ex-" 
cept those from the Disruptive Behavior Scale. - Results of the repeated 
measures analyses are presented in Table IV-11. 

The repeated measures analyses revealed a number of significant 

findings at the intermediate level. On the interpersonal skills variable, 

School Life, both the treatment effect and the change from posttest I 

to posttest II were significant., Life Skills students consistently scored 
' 1 

higher than cJhtrol students- on both 'posttest I and posttest II, but both 



groups also showed significant gains from posttest I to posttest IT. On 
-the classroom climate variable, About My Class , both groups of students 
again showed significant increases over time, from posttest I to posttest 
II. Finally, tm attitud.es toward school, the controj students scored 
significantly higher than the Life Skills students on both testings. 
, * To examine recent drug use more Carefully, a second set of repeated 



-/ 



1 

measures analyses was conducted. The purpose of these analyses was to 

i 

^ determine if any significant changes in recent use of specific drugs had 
occurred from the first *post>test to the secoj|d" posttest. .Results are 
presented in Table IV-12*. 

The analyse§ revealed a notable difference in* recent use of alcohol, 

« " 'i 
with the control group reporting significantly higher levels of alcohol 

s- 

consumption than the Life Skills group. Both groups showed significant' 

increases in the use of alcohol, ,cfgarettes, and amphetamines from the 
* • ** ' 

first posttest to the second posttest. Detailed figures on reported drug 
use for intermediate level students are presented in Table IV-13. 
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Table IV-11 f 

Findings on the Repeated Measures Analyses 
' of Covariance for Intermediate Data 



M 

f 

H 

00 



Instrument 
Myself 

(Self Concept)^ 
School Life 1 



(Interpersonal 
Skills) 

About Class 

(Classroom 

•Climate) 



Attitudes' Toward 
School 



(School Atti- 
tudes) 



pinion on 




rug Attitudes) 
My Opinion/ on 



Drugs ancy 
Alcohol 




(LifctimJ Use) 



Group ^ 


N 


LS 


178 




181 


LS 


177 


. C 


183 


f • 






177 


c 


181 



LS 
C 

LS 
C 



V LS 
C 



171 
178 



162 
.168 



159 
171 



Pretest 

324*80. (SD-31. 18) 
334.89 (SD-33.92) 

330.85\(SD«44.04) 
323.06 (SD-47.04). 

314.64 (SD-46.77) 
325.85 (SD»43.57) 

•I 

309.42. (SD-22.68) 
314.53 (SD-31. 78) 

i 

153.39 (SD-^2.13) 
I1JL8 (SD-53.24)' 



188.09 (SD-13.57) 
185.88 (SD-14.45) 



Post I 

321.43~"(SD-29;08) 
327.51 (SD-35.68) 

329.23 (SD-44.38) 
311.50 (SD-55.67) 

303.82 (SD-40.32)' 
312.81 '(SD»41. 90) 

307.99 (SD-22.72) 
512.73 (SD-29.40) 



147.52 (SD-57.09) 

154.41 (SD-51.11) 

187.75 (SD-11.76) 

185.08 (SD-14.10) 



Post II 


Main Effect 


F 


£ 


Significance 


324.26 ($D«27.68) 


E vs. C 


.543 


.462 


MS 


329.02 (SD-34.23) 


* I vs. II 


1.376 


' .242 


MS 


333.10 (SD-46.88) 


E vs. G 


• 6.90A 


.009 


i 

' * i 


322.79 (SD-51.35) 


I vs. II 


— urn 


— jm— 


* i 

** - 



315.98 (SD-53.30) 
321.54 (SD-48.46) 

308.82 (SD-23.72) 
317.35 (SD-33.99) 



144.25 (SD-53.03) 

147.82 (SD-50".42) 

i 

185.44 (SD-13.79) 

186.92 (S^-12.33) 



E vs.' C 
I vs.'il 

E vs. C 
« 

I vs. II 



.E vs. C 
I vs. II 



E vq. C 
I vs.' II 



' .824 
13.402 

5.731 
2.307 



21040 
2.607 

.3^6 
.122 



.365 
• 000 

.017 
.130 



.154 
.107 



.581 
1 727 



MS 
** 

* 

NS 



NS 
NS 

NS 



* Significant at the p < .05 level. 
** Significant at the p < .005 level. 
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Table IV- 12 



H 
< 
I 

M 

VO 



Findings on Repeated Measures Analyses of Covariance 
on Recent Drug Use at the Intermediate Level 



* ' 1 


Group 


N 


Pre 


SD 


Post I 


SD 


Post II 


SD 


Main' Effects* 


F ' 






Alcohol 


LS 


145. 
161 


1*628 
1.708 


.993 
1.023 


1.662 
1.733 


,850 
,.998 . 


1.697 
1.601 


1.023 
, 1.089 ' 


E Vs. C 
I ys. II 


3.666 
5.969 


P 

. 066 
.015 


Significance 
• * 


Cigarettes 


LS 
C 


149 
162 


1.322 
1.666 


.910 1 
1.162'* 


1.268 
1.681 


.811 
1.105 


1.690 
r.569 


1.107 
1.236 


E vs. C 

I jvs. II _ m 


.526 
6.566 


. 669 
; 011 


NS 
* 


Marijuana 


'LS 


151 
165 


1.225 
1.291 


.750 
.870 


1.126 
1.261 


.565 
.756 


1.265 
1.291 


'.791 
, .819 


* E vs. C 
I -vs. II 


1.196 
2.626 


' .106. 


NS 
NS 


Inhalants 


LS 

I* 


158 

10/ 


1.076 
1.116 


.360 
.625 


1.063 
1.012 


.618 
.522 * 


x 1.057 - 
J..056 


.378 
.368 


Ej vs . C 
11 vs. II 


.063 
.981 


. 836 
.323 


VJC 

Np 
NS 


Barbiturates 


.. LS 

( C 


157 


1.032 
1.108 


.176 
.693 


1.025 

1.026 r. 
* 


.158 
.263 


1.076 
1.036 


.666 
.261 


t vs. C 
1 vs. II 


.969 
' 2.107 


.331 
.157 


NS 
NS 


Amphetamines 


\> 

LS 
C 


159 
169 


1.013 
1.061 


.112 
.296 


1.006 
1.030* 


.079 
.202 


1.069 
1.061 


.679 
.252 


E vs v C 

I V8.' II 


.005 
3.022 


.966 
.083 


NS 
+ 


2 

Cocaine 


LS 
C 


159 
169 


1.025 
-1.067 


.193 
.391 


l.oocr 

1.053 


.000 
.350 


1.006 
1.006 


.079 
.077 


* 








PCP 2 


LS 
C 


159 . 
167 


1.025 
1.036 


'.250 
.288 


1.000 
1.026 


.000 
*.218 


1.000* 

r.ooo 


.000 
.000 










LSD 2 \ 4 


LS t 

c n 


160 
168 


1.031 
1.036 


.325 
.366 


1.025 
1.018 


.316 
. .231 


1.006 
1.000 


.079 
-.000 . 




Heroin 2 


LS 
C * 


158 
170 


1.019 
1.053 


.239 
.365 


1.000 
1.026 


^000 
.216 


1.006 
1.000 


.080 
. .000 





: * 6 .,* t *ucuit a l. uuc p ^ ,iu ievei. 
*• Significant at the p < .05 level. 
1 » " 

1 - None in past three months, 2 - l» 0 r 2 times 
onc<* per day. " • 

2 

Analyses on these variables were not conducted, 



in past three months, 3 - 1 or 2 y times per month, 4 i 1 or 2 times 
due to the extremely low levels of fuse. . 



per week, 5 - more than 
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fable IV-13 



Reported Recent Drug Use During^Past Three Months for 
Intermediate Students, Recorded as Percentages of Total 



Recent Use (Prist 
3 Months) 

How often have 
you : 

drunk alcohol? 

smoked cigarettes? 

smoked' marijuana? 

sniffed inhalants? 

taken barbiturates 
or tranquilizers? 

taken amphetamines 
or stimulants? 

sniffed cocaine? 

used PCE? 

taken LSD or 
other psychedelics? 

used heroin or 
morphine? . 



\ 








, ^Pretest 






s 








LS 


(N=458) 


, ■* 






r 

Control 


(N=350) 






1-2 
times 


1-2 times 
per 
mo n tti 


1-2 times 
per 
week 


More than 
once per 
day 


1-2 

None — -felaoe- 


1-2T times 
* pet 
month 


1-2 times 
per 
week 


More than 
pnce^per 
day* 1 


62.9 


21.0 


6.6 . 


8.3 


1.3 


59 .1 


1 O C\ 

18.9 


-9.7" 


10.6 


1.7 s 


77.7 


8.5 


1.1 


4.6 ' 


8.2 


81.0 


6.3. 


2.6 


2.0 ' 


. 8.0 


85.5 


4.7 


4.0 


• 3.8 ' 


1.9 


83.7 


6.3 


■ 3.i 


3.4 


3.4 


, 95. G 


2.7 


.8 


1.3 - 


.2 


94.7 


1.7 


1.7 


.6 

♦ 


1.4 


96.9 


2.1 

« 


.6 


.4 


' 0 

\ 


°96.7 - 


1.4- 


— 1.1 


.3 

* • 


.6 


97.5 


1.7 


.8- 


0 


t 

0 • 


97.2 


1.1 


1.1 


.6 


0 


98.1 


1.0 


-.4 ' 


.2 


.2 


97.8 


1.1 


0 


.6 , 


.'6 


99.0 


.4 


. .2 


. .2 


.2 


98.6 


.8 


.3 


.3 


0 

1 ■ 


99.0 


.8 


0 




.2 


9 X 8.9 


0 




0 


.6 . 


99.2 ' 


.2 


.2 


.2 


.2 


98.1 


1.1 


. - 6 


0 


~*".3 
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Table IV-13 (cont.) 



< 
I 



Recent Use (Past 
3 Months) 










Post I 










• 

How often have 






LS 


(N=415) 








L»onuro j. 


— * 




you: 


None 


1-2 
times 


1-2 times 
per 
month 


1-2 times 
per 
week 


More than 
once per* 
day 


« 

None 


1-2 
times 


1-2 times 
per 
month " 


1-2 times 
per 
week 


More than 
once per 
day 




64. 3 


20.2 


8.0 


6.7 


.7 


?6.6> 


18.7 


16.0 • 


8.1 


.6 


smoked cigarettes? 


81.6 


5.3 


3.6 


3.6 


5.8 


80.1 


5.7 


4.2 


?-7 


7.2 . 


smoked marijuana? * 


84.9 


6.7 


4.3 


2.6 


1.4 


87.4- ' 


-4.5 


4.8 


2.4 


.9 


sniffed inhalants? 


95.7 


2.1 


1.0 


• 

.5 


.7 


97.3 


.6 


.9 


.9 


.3 


taken barbiturates 
or tranquilizers? 


96.9 


2.4. 


.2 


.2 


'.2 


98.2 - 




.3- 


.6 


0 


taken amphetamines 
or stimulants? 


o98\l 


1.2_ 


.7 


0 


0 

0 • 


96.4 


1.8 


.6 


1.2 


0 


sniffed cocaine? 


98.1 


.9 




.2 


.2-' 


98.5 


.3 


.9 


.3 


0 


used PCP? 


99.5 


0 


0 


:5 


0 


* 99.1 


. 0 


»' .6 


0 


.3 


taken LSD or 
other psychedelics? 

used heroin or 
morphine? . 


99.5 


.2 


0 




.2 


98.8 


.3 


0 


.6 


.3 


99.5 


- .2 


.2 


0 


0 / 


98.8 


0 


.9 


0 


. .'3 
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Table IV- 


• 

13 ,(cont.) 


- 






! 


m 










• 










< 


• 










Recent Use (Past 
3 Months) 






* 




Post II 












■ 


How -of ten have 






LS 


(N=222) 




Control (N=230) •• '. 






vnti * 


None 


1-2 ' 
times 


1-2 times 
per 
month 


1—2 times 
per 


More than 
day 


1-2 
None\> times 


1-2 times 
per 
month 


1-2 times 
per k 
week 


More than 
onfce per 
day 






drunk alcohol? . 


56.8 


22.5 


9.9 


9 0 


1.8 


55.2 


15.7 


17.0 


10.0 


\2.JJ 




t 


sraoked^cigarettes? 


76.0 


8.0 


4.4 




7.1 


80.0 


3.0 


z • 0 


J m £ 


Q 1 






smoked . marijuana? t 


85.6 


3.9' . 


'" 3.5 


S 7 


1.3 \ 


85.3 


3.0 


* 3.9 


5.2 


2.6 




M 


sniffed inhalants? 


96.5 


1.7 


.9 


.9 


0 


96.6 


.9 


.9 


.9 


.9 




f 

to 
to 


takeri barbiturates 
or tranquilizers? 


97.4 


1.3 


.4 


.4 . 


.4 


96.6 - 


' 1.7 


. 1.7 


0 . 


1 

0 


* 




taken amphetamines 
or stimulants? ' 


98.3 


.4 


.4 


0 


S :> < , 


97.0 , 


1.7 


1.3. 


0 , 


0 


• 




sniffed cocaine? 
used PCP? 


99.6 
100 


.4 

/ 

1 

0 


0 
0 


0 

0 * 


0 
0 


' 99)l 
99.6 


.4 
0 


. 0 


.4 
0 


V 

0 

.4 . 

r 


j 
1 




taken LSD or 

other psychedelics? 


99.6 


.4 


0 


0 


0 


100 


0 


0 


0 




♦ 


used heroin Or 
morphine? . 


99.6 


.4 


6 


' ' 0 


.. ..... 1... . ft— 

0 


99.6 


,0 


0 


."4 ■ 


0/ 
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The third set of'i analyses for x th.e intermediate #hta wns performed 
rising reg-r essl^iy-teehni-ques . Resuit-s-are-shown ±n Tabie-*¥-t4. . ~ 



At the intermediate level/ treatment group was a significant pre- f 
dictor of attitudes toward drugs, attitudes toward school, and classroom 
climate. Regarding cfrug attitudes, Life Skills Students "showed a lower 
tolerance toward drug use than their' control counterparts. Next, corre- 
sponding to the previous findings on r^peated^ measures treatment effects, 
qpntrol students scored higher on their attitudes toward school than did 
the Life Skills students. Finally, control students also had higher. 
, predicted scores on classroom climate measures ^hjfn the Life Skills 



students. 

• Sex proved to be a significant predictor of self concept scores and 
of scores on interpersonal skills. On £>oth 'variables, females had sig- 
nificantly higher predicted scores. than males. Ethnicity also was sig- 
nificant in predicting intermediate level attitude^ toward school; non- 
whites show e d consi s tently more po s itive a tt i tudes th a n White r Pretest- 



scores were significant predictors of posttest scores on f our measures; 

Myself , Drug Attitudes , School Life , apd About My ciass ., 

» * 

The final, dependent variableUor the intermediate level was disrup- 
tive behavior. Findings on this variable are* reported in Table IV- 15. 

Table IV-J5 v 
Intermediate Results" oh the Disruptive Behavior Scale 



Group 


N. 


Mean 


S.D. \y 


K 


P 


LS 


345 


2.96 


.862 < 


.51$ 


NS 


C • 


302 


2.99. 


.799 ' 


— * — i 


1 
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Table IV- 14 



Results of Intermediate Regression Analyses 



Dependent 
Variables 

■Salf Concept- 



Inkt 



truments 



"Independent 
Variables * 



Beta 



My se lf 



Interpersonal 
Skills 



Classroom 
Climate 



School Attitudes 



Dr v ug Attitudes 



Lifetime Use 



School Life 



About My Class 



Attitude Toward 
School - 



My Opinion or^ 

Drugs and 
'• Alcohol 



My Opinion on 
Drugs and 
Alcohol 



Pr e te st— fe^ 

Treatment 

Sex 

Ethnicity 

Pretest 

Treatment 

Sex 

Ethnicity 

Pretest 
Treatment 
Sex ' ' 
Ethnicity 

Pretest ' 
Treatment 
Sex 

Ethnicity 

Pretest ' 
Treatment 
Sex 

Ethnicity 

Pretest 

Treatment 

Sex 

Ethnicity 



. 0 97 
.081 
.110 
-.061 

.233 
-.062 
.094 
.003 

.161 
.086 
.068 
-.058 

'.008 
.160 
-.028 
-.148 

.272 
..121 
.009 

' .017 
.026 
-.054 

--o$o 



-3v365- 



2.373 
4.447 
1.326 

20.737 
1.466 
3.367 
.004 

9.486 
2.721 
1.745 
1.259 

..022 
9.510 
.297 
8.130 
I 

28.162 
5.598 
.035 , 
2.280 

. .105 
,245 
1.103 
J315 



.124 
.036 
.245 

.000 
.227 
.067 
.948 

.002 ' 
.100 
.187 
.263 

.883 
.002 
.586 
."00'5 

.000 
.019 
.853 
.132 

.746 
.621 
• 310y 
.576 



Significance 



** 
+ 
,NS 
NS 

NS 
** 

NS 
*** 

* 
NS 
NS 

-NS 
NS 
NS 
NS- 




\ 



+ Significant at the p < .10 level. 
* Significant at the p < .05 level. 
** Significant at the p < .005 level. 
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No signif ic^it dif ferenc^s^in ratings on disruptive behavior between the 
Life Skills and the/cog trol groups were found. 

Discussion . Several treatment effects were found to be significant 
in the analyses *of intermediate data. First, Life Skills students scored 
significantly higher *i the repeated measures analysis of the interper- 
sonal skills variable ^School Life , than did control students. This find- 
ing indicates that the Life Skills program may be helping students 'to * 
better understand theit peers. • , A . 

On both the repeated measured analyses, and the regression analyses, 
* #• 

control students sctfred significantly higher'^hattpji^e Skills s^tuctents on 

attitudes toward school. No ready explanation can be offered for this 

% » # 
finding. - ' % 

On the measures of interpersonal skills, School Life , and classroom 

climate r About My* Clags , 'scores for both groups increased significantly 

/ v , 
f rom ^o^test L to posttest II. These findings may reflect a general in- 

. = \ ,/ * * 

cxease in/the iflt$£me&iate students' ability to understand and communi- 

cat^^i throne andther^, Regarding drug use, the repeated measures analy- 

e . : 
seS showed significant ,in£rea&es in use of alcphol, cigarettes, and 

amphetamines for Bafch^he Life ^Skills and the control students from post- 
test I to posttest 11^ This finding is similar t6 tft frt - -f o r the upper 
elementary level, where there was a significant Increase in recent drug 

use from posttest I to posttest II. These results seem , to indicate a 

* • 

general trend toward increased d^ug usage at all levels rather t)ian the 

• « » 

hypothesized critical? peiriod .of experimentation, limited to the upper 
elementary level. . 4 V * 

C •• • • * ' • ' . . 
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9 In the recent use of alcohol, control students reportecTsignif icantly 

higher levels of use than Life Skills students.. This result is the only 
instance of a difference between the 4 treatment groups on recent or. life- 
time use of drugs. 

-Sex was a significant predictor of, scores on self concept and^ inter- 
personal skills, with females showing higher predicted scores than males 

- on both variable!*. In contrast to findings for upper elementary students, 
sex was not a Significant predictor of drug attitudes or drug use for 
students at *the intermediate leve\. Ethnicity again proved to be a sig- 
nificant factor in predicting attitudes toward school, with nonwhites 
showing more positive attitudes than whites, as at the upper elementary 
level. Finally, the regression analyses* revealed that for students at 
the intermediate level, treatment group was a significant predictor of 
classroom climate scores and of drug, attitude. Control stutents had 
highejp predicted scores on classroom climate, but Life Skills students 
were less tolerant toward drug use than % their control counterparts. ' 



4 



i 

High School Results , 



The same set of instruments used to measure intermediate attitudes 
and behaviors were used for^the high school level, with the exception of 
0 • substituting a parallel form of the Attitudes ^Toward School measure, 
fable IV-10 in the sectiorr^m intermediate level results lists these 
measures. 

Findings^ For all measures except the Disruptive Behavior Scale , 
repeated measures analyses of covariance were conducted. Results are 
/rJS^rted in Table IV- 16. * » - 
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Table IV- 1$ 



M 

<: 

ho 



Findings on the Repeated Measures* Analyses 
of Covariance for High School Data 



Instrument 
Myself 

(Self Concept) 



School Life 
(Interpersonal 
Skills) 



About My Class 
(Classroom 
Clfpate) 

Attitude Toward 
School 

(School Atti- 
tudes) 

My Opinion on 
Drugs and 
A I cohol 

(Drug Attitudes) 



My Opinion on 
Drugs and ^ 
Alcohol 
(Lifetime Use) 



Group N 
LS 120 



LS 
C 

LS 
C 

LS 
C 



LS 
C 



LS 
C 



37 

120 
' 37 

118 
37 

110 
34 



116 
37 



112 
32 



Pretest 

326.98 (SD-31.29) 
333.11 (SD-32.66) 

340,32 (SD-48.57) 
305.27 (SD-44.75) 

332.99 (SD-39.21) 
313.92 (SD-41.62) 

262.86 (SD-20.74) 
262.59 (SD-16.96) 

/ 

' 1S3.03 (Sp-39*18) 
137;62 (SD-35.00) 



187.28 (SD-11.73) 
187.^4 (SD-10.69) 



f Post I 

324.79 (SD-29.58) 
328^57^jCSD-22.93) 

342.15 (SD-42.31) 
.324.65 (SD-48.06) 

332.42 (SD-41.54) 
324.59 (SD*31.05) 

2&T756 (SD-20.04) 
0/35 ^(SD-16.16) 




2.40 (SD-44.15) 
137.19 (SD-32,28) 



187.46 (SD-11.39) 
187.34 (SD- 9.93) 



Post II | 

326.07 (SD-25.87) 

324.30 (SD-23.13) 

347.38 (SD-44.86) 

327.70 (SD-47.90) 

333.87 (SD-38.73) 

316.84 (SD-47.75). 

262.47 (SD-16,46) 

260*06 (SD-15.04) 



141.51 (SD-45.98) 
139.16 (SD-36.57) 



186.42 (SD-11.20) 
184.47 (SD-14.67) 



Main Effect 

LS vs. C 
I vs. II 

E vs. C 
I vs. II 

E vs. C 
I vs. II 

E vs. C 
I vs. II 



E vs. C 
I vs. II 



E vs. C 
I vs. II 



.209 
.412 

.178 
.797 

1.938 
.557 

.476 
.023 



• 106 
2.001 



.54$ 
4.969 



2 

.648 
.522 

.674 
.373 

.166 
.457 

.492 
.879 



.746 
.159 



.460 
.027 



Significance 

NS 
NS 



NS 
NS 

V 

NS 

NS 
NST 



NS 

» 

NS 



NS 
* 



* Significant at the p < .05 level. 
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The repeated measures analyses for the high\ school level revealed 
only one significant finding On- the reports of overall lifetime use 
of drugs, the analyses showed a statistically significant decrease ita use 
from the first posttest to the second posttest for both Life Skills <8id 
control students. Since the actual decrease Jn scores from posttest I 
to posttest II was small, this finding may be an artifact of sample size" 
or of the high school students* increased reluctance to report actual use. 
That is, by the third test administration, high "school students may have 
/developed a' tendency to report lower levels of usage than actual monitor- 
ing of drug use would show. A a 
Findings on recent drug use, presented in Table^MJ^show one 

♦ 

significant result: an increase in the use of alcohol for both groups 
from posttest I to posttest II. This result not only corresponds tol 
findings of increased ijsage «t other levels,- but also further calls/into 
question the practical jsig^icance of the reported decrease in lifetime 

use. More speciJlC-^Lgures op reported rerentL-dxu&-use-for-high school 

students are presented in Table IV-18. _ 

Regression analyses also were conducted for the high school data. 
Results are presented i|i' Table IV-19. On the variables of attitude toward 
drugs and attitude toward school, sex was a significant predictor. On 
attitude toward drugs, females showed less tolerant attitudes • toward dsug 

use than did males. On attitudes toward school, females were less posi- 

\ ! 

tivethan males. Ethnicity was also a significant predictor for drug 
attitudes; whites were less \tolerant toward drug use 'than nonwhites at 

\ " IV " 2a • , \ 



Table IV-jrf 

Findings- on Repeated Measures Analyses of Covariance 
on Recent Drug Use at the High School Level 1 









Drua 


Group 


N 


c 

Pre 


SD 


Post I 


SD 


Post II 


SD 


Main Rffprr 


r 








Ale o|jo 1* 


LS 
'C 


108 
30 


1.565 
1.633 


.823 
.928 


1.704 
1.767 


.969 
1.006 


1.870 
1.933 


1.077 
.1.015 


E vs. 

r vs. 


c 
ii 


.012 
3.507 


P 

.912 
.063 


Significance 

NS 
+ 




Cigarettes* 


LS 
C 


105 
3] 


1,486 
1.516 


1.233 
1.208 


1.514 
1.806 


1.249 
1.493 


1.533 
1.581 


1.279 
1.311 


E vs. 
I vs. 


c 
11 


.885 
1.301 


.348 ' 
.256 


NS 

NS' ^ 




Marijuana 


LS 
C 


109 
32 


1.147 
1.188 


.541 
.592 


K193 V 
1.375 


.713 
.942 


1.193 
1.281 


.739 
t 813 


E vs. 
I vs. 


c 

11, 


'1.129 
.707 


.290 
.402 


^ NS 
NS 




Inhalants 


LS 
C 


112 
32 


1.009 ' 
1.031 , 


.094 
,177 


1.009 
1.031 


.095 
.177 


1.000 
1.031 


.000 
x .177 


E vs. 
I vs. 


c" 
II 


r- 

2.657 
.094^ 


.105 
.759 


NS 
NS 




Barbiturates 


. LS 
, C 


112 


1.063 
1.000 


.386 
.000 


1.018 
1.000 


.189 
.000 


1.036 
1.031 


.230 
.177 


E vs. 
I vs. 


c 
II 


,.445 
1.229 


.506 * 
.269 


^ NS 
NS 


IV-29 


Amphetamines 


LS 
4 C 


112 ' 
32 


1.054 
1.000 


.351 
.000 


1.036 

1.000 , 


.230 
.000 


1.036 
1.063 


.230 
.jJ54 


E vs. 
■ I vs. 


c 
II 


.331 
.870. 


.566* 
.353 


NS 
NS 




Cocaine 


, LS 
C 


-112 
32 


1.000 
1.000 


.000 
.000 


1.000 
1.000 


.000 ' 
.000 


1.000 ' 
1.063 


i 

.000 
.354 










9 


* 


pcp 2 


LS 
C 


110 
32 


1.009 
1.000 


.095 
.000 . 


• i;ooo 

l.OfiO 


.000 
.006 : 


1.000 
1.000 , 


.000 
* .000 










O 




LSD 2 


. LS 
C 


112 
32 


1.000 
1.1)00 


v 000 
.000 


• 1.000 
1.000 


.ooo : 

.000 ' 


1.000 . 
1.000 


.000" 
' . .000 






Heroin 2 * 


LS 
C 


' 111 
32 


1.000 
1.000 v 


.000 
.000 


' 1,000 * 
1.000 


.000 ' 
.000 l • 


1.000 
1.000 


.000 
•± .000 


\ : : 



+ Significant at the p < level. 

h tlZ i f rpLl\h d ree lonSs T-TorfJm accordance with the following numerical scale : 1 - None in past three months, 2 
^ n past months, 3 - 1 or 2 times per month, ,4 - ,1 or 2 times pes week, ,5.- More than.pnce per day. 

Analyses on .these variables were not conducted due "to the extremely low levels of .Use. ' - 
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Table IV-18 



Reported Recent Drug Use Dqring Past Three Months for 
High School Students, Recorded as Percentages of Total 



Recent Use (Past 
3 Months) 


Pretest 


How often have 
















Control (N= 


120) 




you : 

* 


None 


1-2 
-times 


1-2 times 
per 
month 


1-2 times 
per 
week 


More than 
once per 
day 


None 


..'.1-2 
times 


1-2 times 1- 
per 
month 


-2 times 
per 
week 


More than 
once per 
day 


drunk alcohol? 


52.4 


19.7 


14^ 


12.2 


.8 


48.3 


24.2 


10.8 


15.8 


.8 


smoked cigarettes? 


76.9 


3.8 


1.5 


. 4.4 


13.4 


68.6 


5.0 


3.3: 


4.1 


19.0 


smoked marijuana? 


78.2 


6.*5 


3.8 


6.4 


5.5 


78.5 


5.8 


.8' 


9.1 


5.8 


sniffed inhalants? _ 


98.9 


.9 


0 


0 


.2 


98.4 


1.6. 


> 0 


0 


0 • 


'taken barbiturates 
or tranquilizers? 


94*. 2 


2.4 


• 2.0 


_ __ 




95.9- 


' 3.3 


0 


0 


0 


taken amphetamines 
or stimulants? 


93.5 


3.0 


2.0 




.2 - . 


95.1 


3.3 


1.6 


" * 0 


0 




98.0 


.7 


.9 


.4 


0 


.96.7 


2.4 


.8 


0 


0 • 


used PCP? 


98.3 


~ ' .9 


: -A 


A 


0 


100 


0 


0 


0 


0 


tal^en LSD or 
other psychedellcs? 


98.5 ' 


.7 


* 

.4 


.it 


Q 


100 


e 

0 : 


. ' 0 


0 


0 . 


used heroin or 
morphine? . 


99.4 


0 


.4 


« 

0 


— -.2 


99.2 


0 


.8 


0 

« 


0 





• 


















c- 








• 


• 




y 


Table IV-18 


(cont.-). 


* 






\ 




4 




Recent Use (Past 




4 * 






Post I 






• 








3 Months) 






LS 


(N=476) 








Control 


(N-55) 






« 


How oftenyhave 
you: 


None 


, 1-2 
times 


1-2 times 
per 
month 


1-2 times 
weejt ^ , 


More than 
once per 
day 


None 


1-2 
times 


1-2 times 
per 
month 


1-2 times 
per 
week 


More than 
once per 
day 






drunk alcohol? 


49 .*4 


24.8 


12.6 


12.8 


.4 


56.4 


14.5 


18.2 


9.1 


1.8 


0 


smoked cigarettes? 

"V r •" • 

y^^stnoked mar^i^anaj 


75.0 
80.5 


5.0 
5.6 


2.5 
3.8 


1.5 
6.5 


16.0 
3.6 


80.0 
78,2 


1.8 
9.1 


1.8 
3.6 


5.5 

-> 

7.3 


10.9 
1.8 




[V- 3 


sniffed inhalants? 


98.4 




-J* 


.2 


0 


98.2 


1.8 


0 

i 


, o 


a 




— 


taken barbiturates 
or tranquilizers? 


96.7 


1.4 


1.2 


C 

.6 


' 0 

/ - 

0 • 


100 - 


0 


0 


0 


0 


3 




taken amphetamines 
.or stimulants? 


94.4 


. 2.1 


' 2.5 


1.0 


100 


0 


0 


0 


0 






sniffed cpcaine? 


•98.6 


.6 


.4 


.4 


0 


100. 


0 


0 


0 


0 






used PCP? _ 


99.6 




0 


0 

• 


.2 


100 . 


0 


0 


0 


0 


*- 


t 


• 

taken LSD or * 
other psychedelics? 


99.8 


0 


0 


.2 


0 


100 


0 


0 


0 


0 






used heroin or 
morphine? . 


99.4 


.2 


• 0 


— .2 


.2 


100 


0 


0 


0 


0 
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<* 


1 




1 
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Table IV- 18 

* 


(cont .) 


• 




* 




t 

n 






Recent. Use (Past 
3 Months) 

4. U 

How often have 
you: 

- 


- < Post II 








> 


LS 


(N- 218) 








Control iU 


-57) 








None 


1-2 
times 


1-2 times 
per 
month 


1-2 times 
per 
week 


More than 
once per 
day 


None 


1-2 
time 8 


1-2 times 
per 
month 


1-2 times 
per 
week j 


More^than 
once per 
day 


• 




drunk alcohol? 


48.2 


, 29.4 


11.5 , 


10.1 


.9 


38.6 


'29.8 


19.3 


12.3 


0 






smoked cigarettes? 


81.1 


' * / 
5.(5 


0 


2. 3 


11.1 


79.3 


5.2 


3.4 


1.7 


10.3 






smoked marijuana? 


88.9 


4.1 


' .9 


3.2 


2.8 ' 


86»0 


1.8, 


5.3 . 


5.3 


1.8 




1-4 


sniffed inhalants? 


99.5 


0 


• 0 


.5 


0 


98>2 


1.8 


0 


0 


0 




V-32 


taken barbiturates 
or tranquilizers ( 


97.3 


1.4 


1 


0 ' 


' 0 


98.2- 


' 1.8 


0 


0 


0 


• 




taken amphetamines' 
or stimulants? 


96.8 


!•* 


1.8 


0 


0 • 


96.5 


1.8 


1.8 


4 

0 


0 






> 

sniffed cocaine? * 


99.5 


.5 


0 




' 0 


98.2 


0 


. 1.8 ,. 




0 






used rCP f 


10Q 


0 


0, 


0 


0 < 


100 


0 


0 - 


0 


0 






t 

taken LSD or 

other psychedelics? 


100 


0 


0 


, 0 


'm 

0 


100 


0 


0 


0 


0 






used heroin or * 
inorpnine r 


< 

100 ' 


0 


0 


0 


■ 0 


100 


4 \ 0 


0 


* o 


0 


< 
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Table IV-19 
Results of High School Regression Analyses 



Dependent 
Variables ^ 

Self Concept 



Interpersonal 
Skills 



Classroom Climate 



Instruments. 



Myself 



School Life 



School Attitudes 



Independent 
<j Variables 

* Pretest 
Treatment 
Sex 

Ethnicity 

Pretest 
Treatment 
Se/x 

EGhnicity 

Pretest 
Treatment 
Sex 

Ethnicity 
JjLtLttLUdjg Toward P r of-ppf 



About My Class 
q — * 



Dfug Attitudes 



Lifetime* Use 



School 



My Opinion on 
Drugs arfd 
•Alcohol 



My Opinion Qn 

Drugs and , 
- Alcohol 



Treatment 
Sex 

Ethnicity 

Pretest 

Treatment 

Sex 

Ethnicity 

pretest 
, Treatment 
Sex 

Etfinicity 



Beta 


F 


• £ 


.349 
t.056- 
.003 
.038 


23.441 
.502 
.001 
.234 


.000 
.480 
.969 
.629 


.349 * 
-.049 
.013 
.094 


18.824 
.384 
1.364 
.028 


.000 
.536 
.245 
.867 


.102 - 
» -.099 
.119 
-.038 


1.629 
1.413 
2.041 • 
.229 


.204 
.236 
.155 
.632 


--.-045 
-.131 ' ' 
-.199 
-.061 ■ 


— - -.036 
2.501 
5.571 
.589 


.8-49 
M16 
.020 
.444 


.266 

HOC 
— • Uoj 

-..154 
-.19? . 


12.357 
1.C63 
5.889 
4.058 , 


+ .001 
.283 
.016 

.046 

> 


.010 ' 
-.082 
-.104 

.027 , 


.017 
.939 * 
1.508 
.113 


.899 
.334 
%■ .221 
.737 



"* Significant at 
** Significant at 



the 



Significance 

** 

NS 

NS , 
" .NS 

** 
NS 
NS 
NS 

NS 
^NS * 
NS 
NS- 

v NS 

NS 

NS. 

** 

NS 
*-* 
/ * 

NS 
• NS 
NS 
NS 



e p < .05 level, 
the p < .005 level. 



the high school level. >Pretestuwas a significant predictor for Drug 
Attitudes , School Life , and Myself . 

Disruptive behavior was the f j|ial dependent variable for the high 
school level. Results are shown in Table IV-20. 

Table IV-20 

High School Results on the Disruptive BehavicfPScale ^ 



Group 


N 


Mean * 


SD 


t 


P 


LS 


294' 


' 3.02 


.606 


.695 


NS 


C 


64 


3.06 


.390 . 



No significant differences in ratings on disruptive behavior between the 
Life Skills and the control groups were found. 

Discussion . Results' at the high school level for the most part 
showed no significant differences 'between the Life Skills and the control 
groups or between overall performance on the first posttest and the second 
posttest . The repeated measures analyses showed one statistically signi- 
ficant* decrease in scores from the first posttest to the second posttest 
on reported lifetime use of drugs. However, careful examination of this 
result suggested that although the finding may be statistically signifi- 
cant, its practical significance is questionable;* in fact, very small 
decreases occurred from posttest I to posttest II in lifetime tise of 
dru££. The high school students also may have been mor$ cautious in re- 
porting J^eir history of drug use by the. time of the second posttest, 
thus resulting in a slight decrease in lifetime use scores. 

The regression analyses showed sex to be a sigfiif icajit predictor of 
two variables, attitude toward drugs and attitude toward school. As at 
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the upper elementary level,' females were less tolerant in their attitudes 
toward drug use than males. However, in attitudes toward school, females 
were less positive than males, whereas at the upper elementary level, 
females were more positiv^ than males in their attitude toward school. 

Ethnicity also was a significant predictor J>f drug attitudes at the 
high school 'level, with whites -having less tolerance toward drug use than 
-nonwhites. 

Findings on Classroom Observations > 

Classroom observations were conducted as a part' of the outcome evalua 
tion, using the Life Skills for Mental Health Classroom Observation 
Form. As a part of the observation task, observers rated students on. a 
series of 14 affective behaviors, included in section 7 of the form. In 
Life Skills classes, two observations were conducted— one during a time 
when Life Skills activities were taking place and a second during a regu- 
lar classroom lesson. In the control classes, only regular lessons could 
be observed. Thus, three groups of observations were gathered: observa- 
tions on Life Skills activity periods, observations otj regular lessons 
♦in Life Skills classes, and observations on control classes. * 

Scale scores were computed from the ratings on the 14 affectivfc stu- 
dent behaviors and compared^ using a 2x3 analysis of variance. Results 

are presented in Table IV-21/ 
* 

The treatmenj^ffect wis significant. Inspection of the mean scores 
shows that the LS activity g\roup students were rated highest on affective 
behavior, while' the LS regular^lesson group was rated second highest, and 
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Table IV-21 



Results of Analysis of Variance on Observation Ratings 
of Student Affective Behaviors* 



f 



f 

ON 



^ Group 


Pretest 
Mean 


S.D. 


Posttest 
Mean 


S.D. 


Main 
Effect 




• P 


Significance . 


LS Activity 


2.941 


.494 


3.045 ' • 


.570 


Treatment 
Group y 


4.002 


• 9 

.046 


* 


LS Regular^ 


2.797 • 


.• .469 
\ 


2.947 


-.530 , 


Pre££st vs. 
Posttest 


4.229 


.041 


** * 


Control 


2.764 


.548 


2.761* 


.583 











* Significant at p < .05 level. 
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the control group received the lowest ratings on both the pretest and 
posttest,. Differences in pretest and posttest scores also were signifi- 
cant; examination of" these differences shows a very interesting trend. 
Both th£ LS activity .group and the LS regular group students increased 
their scores on affective behaviors from the pretest to\he posttest, but 
the control group stayed virtually the same over time, showing no increase 
in their affective behavior scores. 

These findings on observed student affective behaviors show some Very 
positive effects of the Life Skills program. Each of the 14 student be- 
haviors included in the observation form^can be cjirectly linked to objec- 
tives of # the Life Skills program. Thus, these ratings reflect more direct 
measures of program impact than any other measures use4 in the outcome 
evaluation. Life Skills students involved in both Life Skills activities 
and regular classes were not only rated more highly on their affective 
behaviors, 0 but they also showed significant positive increases from pre- 
test to posttest while the control group showed no change. These results 
provide direct evidence that the Life Skills program is achieving its 
seated objectives.' 

Summary 

Results of the student outcome analyses have been presented and 
discussed for each age group of student participants. In order to sum- 
marize significant trends, the results will be .examined across age groups' 
and by type of variable. 

Treatment Effects . Overall treatment effects will be addressed 

first. A summary of significant findings is presented in Table IV-22 . 

/ 
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Table IV-22 

Summary of Treatment Effects on 
Repeated Measures Analyses of Covariance 



( - 



Dependent 
Variable 


Instrument 


Age Group 


Direction 


p 


> 

Significance 


Self Concept 


Myself 


- 

EE 


T C 

^ LS 


> c 


5 

.031 


* 






UE 


T C 

Lb 


m t» 


.902 


MS 






I 


LS 


- c 


.462 


NS 






HS 


LS 


- c 


.648 


NS 


Interpersonal . 


My Class 


. EE 


LS 


» c 


.987 


MS 


Skills 


bcnool Lire 


' UE 


LS 


», c 


.830 


MS . 






I 


LS 


> c 


.009 


* 






HS * I 


LS 


» c 


.674 


NS 


Classroom Climn^ 


About Your Class 


V 

EE 


LS 


- c 


.366 


MS 






UE, 


LS 


- 


.625. 


NS 






I./ 


LS 


« c 


.365 


MS 






HS 


LS 


- c 


.166 


NS 


School Attitudes 


Attitude Toward ' 


UE 


LS 


- c 


.369 


NS 


* 


School 


I 


C > LS 


.017 


* 






HS 


LS 


- c - 


• 

.492 


NS 


Drug Attitudes 


{ My Opinion 


UE 


LS 


* c 


.166 


NS 




My Opinion on Drugs 


I* 


LS 


- c 


.154 


NS 




and Alcohol 


HS 


* LS 


. c 


.746 


NS 


Llf-etirae Hap 


My opinion 


. UE ' 


LS 


- c 


.675 






My Opinion on Drugs 


I 


LS 


- c 


/* .581 


no 




and Alcohol 


HS 


LS 


- c 


/' ..460 


NS 


sRecenc Use 


• 

My Opinion 


UE 


IfS 


- c 


.688 




Alcohol 


My Opinion on Drugs 


>I 


- C > LS 


•064 


* 




and Alcohol 


HS 


LS 


- c 


• 912 


NS 


- Cigarettes 


* 


. 1 


LS 


- c 


.,469 ' 


NS 






HS , 


LS 


«■ c. 


.348 


NS 


Marijuana 




I 


LS 


■ c 


• Z75 


NS • 






HS 


LS 


■ c 


.290 


NS 


* Significant at p < .05 level. 
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For self concept at the early elementary level and interpersonal skills- 

the intermediate level, significant treatment effects were found favor- 
ing thej-ife Skills group. On use of alcohol at the intermediate level, 
results also favored the Life Skills group, since controls reported sig- 
nificantly higher, levels of use. However, regarding school attitudes at * 
the intermediate level, results favored the control grpup over the Life 
Skills group. Each of these findings was on a different .variable, thus 
providing no evidence for any noteworthy trends. Overall, 'these results 
do not warrant any conclusive -statements on treatment effects. There 

appears to be very little difference in the performance of the Life Skills 

• * 

and the control students. 

* D i ff erences from Postte st I to Posttest II . The main effect measur- 
ing differences in scores for both student groups fro* posttest I to 
posttest II yielded a number of significant findings. A summary of these 
results is shown in Table IV-23. First, scores on self concept at the 
upper elementary level declined from posttest I to posttest II. This re- 
suit was somewhat puzzling; no explanation could be hypothesized for this 
finding. On interpersonal skills, early elementary and intermediate, stu- 
dents showed significantly positive changes from posttest I to posttest 
II. The intermediate students also evidenced increases in their scores 
on classroom climate during this time. A likely explanation for these 
findings may be maturationa^ changes which effect how students interact 
with their peers at these ages. 

Although not evident at all levels ,. recent use and overall lifetime 

* • 

use of drugs increased significantly from posttest! to posttest II for 



t 
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Table IV-2J 

Summary of Changes from Posttest I to Posttest II 



Over Both Experimental Groups 



Dependent 
Variable 



Self Concept 



Interpersonal 
Skills 



Classroom Climate 

School Attitudes 
Drug Attitudes 

Lifetime Use 

Recent Use 
Alcohol 

Cigarettes 
Marijuana 



Instrument 



Myself 



My Class 
SchoolflLlfe 



About Your Class 



"Attitude Toward 
School 



My Opinion 
My Opinion on 

Drugs and Al- 

coho 1 

My Opinion 
My Opinion on 

Drugs and Al- 

cohol 



My Opinion 

My Opinion on 
Drugs and Al- 
cohol 



Age Group 



EE 
UE 
I 

HS 

, EE' 
UE 
I 

HS 

EE 
UE 
I " 

HS 

UE 
I 

HS 

UE 
I 

HS 



UE 

I ' 
HS 



UE 

I % 
HS 



HS 

I ' 
HS 



direction 



PII - PI 
PI > PII 
PII - PI 
PII - PI 

, PII > PI 
PII » PI 
PII > PI 
PII - PI 

PII - PI 
PII « PI 
PII > PI 
PII « PI 

PII « PI 
PII - PI 
PII « PI 

PII - PI 
PII «• PI 
PII - PI 



PII > PI 
PII - PI 
PI > PII 



PII > PI 

PII > PI 
PII > PI 

PII > PI 
PII - PI 

PII ^ PI 
PII - PI 



• 126 
.024 
.242 
.522 

.000 
.153 
.005 
.373 

.586 
.185 
.000 
,457 

.929 
*130 
.879 

.536 
.107 
.159 



.076 
.727 
.027 



.000 

.015 
.063 

.011 
.256 

.-106 
.402 



Significance 



NS 

NS 
NS 

** 

NS 
** 

NS 

NS 
NS 
** 

NS 

NS 
NS 
NS 

NS 
NS 
NS 



. + 
* NS 

it it 

it 
+ 

NS • 

NS 
NS 




+ Significant at p < .10 level. 
* Significant at p < ,05 level. 
** Significant at p< .005 /level. 
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the upper elementary students . Intermediate students showed significant 
increases in their use of alcohol, cigarettes, and amphetamines during 
this same time period, and high school .students reported significant in- 
creases in their use of alcohol. These findings suggest" -that students 
in grades four to eight were experimenting more with readily assessible 
drugs such as alcohol, cigarettes, and amphetamines; high school students 
only showed increases in their use of alcohol. 

One other significant change in sebres from posttest I to posttest 
II was noted. At the high school level, lifetime use of drugs increased 

* t 

from posttest I to posttest II." Consideration of the small* actual de- 
creases' in use scores and the hypothesis that high school students may 
have grown more cautious in reporting their actual drug use promoted the 
conclusion that this finding, although statistically significant, could 
not be considered practically significant. • «• 

Predictor Variables . The regression analyses examined the contribu- 
tions of treatment, sex, and ethnicity in predicting performance on the 
dependent variables. A summary of significant findings is presented in 
Table IV-24. 

• > 

Regression results on treatment as a predictor showed control stu- 
. dents at the intermediate level' to have higher predicted scores on both 
classroom climate and school attitude. The findings on school attitude 
paralleled those from the. repeated measures analyses. On drug attitude*', 
the intermediate levsl-controls had higher predicted scores, indicati^ 
more tolerance' toward dsug use and thus favoring the Life Skills groupV 
No trends or patterns were evident in these findings. 
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Predictor 
Variable 



Treatment 



Sex 



Ethnicity 



Table IV- 24 

Summary of Regression Results by ^Predictor Vari<S£le 



Dependent 
Variable 



Classroom 
Climate • 

School Attitudes 



Drug Attitudes 

Self Concept 

Interpersonal 
Skills 

School Attitudes 
Drug Attitudes 

Lifetime Use « 



Interpersonal 
Skills • 

School Attitudea 



Drug Attitudes 



Instrument 



Age Group 



Result 



Significance 



About Your Class 



Attitudes Toward 
School 

My Opinion on Dru^s 
and Alcohol 



Myself 
School Life 

Attitudes Toward « UE 

School ' flg 

My Opinion *i UE 

My Opinion on HS 
Drugs and Alcohol' 

My Opinion UE 

School Life *UE 

Attitudsjg Toward UE 
School V * I 

My Op in J. on on HS 
Drugs and Alcohol 



C > LS 

C > LS 
7 

C > LS 

F > M 
F > M 

F > M ' 
M > F 

M > F 
M > F 

H > F 
W > NW' 



NW > W 
NW > W 

NW* > W 



.100 
.002 
.019. 

.036 
.067 

.001 
.020 

.006 
• 016 

.000 
.023 



.001 
.005 

v046 



** 



** 



** 



+ Significant at the p' < .10 level. 
* Significant at the p < .05 level. 
** Significant at the p < .005 level. 
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The findings on sex as a predictor |^iable yielded somewhat more 
interesting results. On self concept and interpersonal skills at the 
intermediate level, females had higher predicted scores. However, the 
results regarding school attitudes were mixed. At the upper elementary 
level females scored better, but at the high school level males had higher 
predicted scores on school attitudes. More consistent findings were 
evident on drug attitudes. At both the upper elementary and high school 
^ levels, males had higher predicted scores on their tolerance for drug use. 
Males at the upper elementary level also had higher predicted lifetime 
use of drugs. 

Ethnicity as a predictor showed mixed findings. Whites had higher 
predicted scares than nonwhites on interpersonal skills scores at the I 
nipper elementary level, but nonwhites at both the upper elementary and 

♦ 

intermediate levels had higher predicted scores on school attitudes than 
whites. Nonwhites had higher predict^ tolerance toward drug use than 
whites at the high school level. 
^ Disruptive Behaviou r. Li^e Skills students at the early elementary 

2nd upper elementary levels were rated as evidencing significantly more 
changes toward less disruptive behavior . from the pretest to the posttest 
than the control students. No significant differences were found oh this 
variable at the intermediate or high school * levals . These findings sug- 

4 ' 
t ' » 

gest tjiat the Life Skills program may have a positive^ ef f ect at the ele- 
mentary levels in reducing disruptive behavior. / 
* 

Observations of Affective Behaviors? . Thd findings on- observed stu- 
dent affective behaviors showed very encouraging findings. Life Skills 
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students were not only rated significantly higher' than the' controls on 
their affective behaviors, but they also showed positive' increases from 
pretest to posttest while the control group showed no change. These re- 
sults provide direct evidence that the Life Skills program is achieving 
its stated objectives. 



ERIC 



, W Teacher Outcomes 

Results of the teacher outcome evaluation are organized according 

/ * 
to four major dependent variables. . Test measures and their correspond- 
ing* variables a^ listed in Table IV-25. , 

r 

Table IV-25 

Teacher Outcome Instruments and Dependent Variables 



Dependent Variables 


Instruments 


Teacher Attitudes Toward Mental 


' Life Skills for Mental Health 


♦ ' Health 


Opinion Survey 


Teacher Us* of Life Skills Pro- 
gram^ \ 

Teachgr 'Perceptions of Program 
Benefits 

• 


Life Skills for Mental Health/ 
. Teacher Survey 
V 


Teacher Affective Behaviors 


Life .Skills -for Mental Health 


* » • • 
— — * \ ' 


Classroom Observation Form 
r - ^ ■ 



For each variable, data w§re analysed' according to the structure of the 
instrument. Findings are presented in the following sections. 



Teaqfter Attitudes Toward Mental Health # J ' 

Attitudes toward mental health 'were measure^ on the Lifie .Skills 
Mental He alth Opinion Survey * a 13 item qp6sttoiuiaire administered to ^ ' 



s ffe 
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both Life Skills and control teafchers on a pre/post basis. Duel to the 
wording of questions on this survey, it was not possible to' construct a 
clearly defined continuum of scale scores reflecting entirely positive 
or negativkj attitudes toward mental" health. Instead, item statistics 
for each question were commuted and wilL be discussed individi^ajiy< . 
Sample . The sample segments for this- survey are shown in Table 



IV-26. 



Table IV-26 

Teacher Sample on ihe Life Skills 
for Mental Health Opinion Survey 



fret 



test 



Posttest 



LS 



N = 62T 

' • J 


, <- 
N = 50 


N = 25 ' 


N = 15 \ 

* 



Within each segment, the distributiorr^atross grade levels is des-' 

cribed in T^>le IV-27. In afiy- segmen^t, a minimum of twelve percent of 

the teachers represented each grade level- grouping. 

Table IV-27 

Percent of Teachers Falling Within 

Each Grade Level Grouping . * 





Pretest 


Posttest 




• LS * 

(N=62) ' 


*C 

(N=25) • - 


LS 

(N=50) 


C 

' (N=15) . 


Early ( * 
Elementary 


.26 


.12- 


-22 


.20. 


Upper 
Elementary 


.24 


.28 


' :34 


' .20 


Intermediate 


• 2.4 


.44- 


.18 ' ' 


.40" 


High School 


. « 26 


.16 


.26 • 


.20 






f 
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Findings . Item means and changes from pretest to posttest fot the 
Mental' Health Opinion Survey are presented in Table IV-28. The results 
are depicted graphically in Table. IV- 29. On most items, changes were 
small, and the means for the Life Skills and control groups were similar. 
However, in several cases resuiti for the two groups varied considerably. 
On Item 1, Life Skills teachers, moved slightly more toward agreement with 
the statement that "Good mental health is desirable but not absolutely 
essential for maximum classroom learning; 11 control "teachers moved toward 
stronger disagreement with this statement. Item 8 was worded "Telling a 
student how he/she should behave takes away the opportunity for the stu- 
dent to learn how his/her behavior affects others." Life Skills teachers 
tended to disagree wi^ this statement more at the posttest than* at the 
pretest; control teachers showed little change. Items 12 and 13 also 
produced some moderate shifts. Both Life Skills and control " teachers ex- 
pressed more disagreement at posttest than at pretest with t^ie statement; 
'lit is extremely difficult to effectively integrate .cognitive and affective 
education within the same curriculum .activities." However, on Item 13, " * 
"Children in school should be exposed only to those valueVj*h^ are com- 
monly held by our own society," control teachers disagreed more at post- 
test than pretest while Life .Skills ^teachers remained relatively stable . ' 
.in their, attitudes on this item. 
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Table IV-28 

v Item Means on the Life Skills for 
Rental Health Opinion Survey 



Item* 


Group 


. Pre 


Post 


Change 




Q 1 


I LS 
C 


2.016 
2.#0 


2.200 
1.867 


.184" 
-.533 


# 


Q 2 


LS 
C 


1.355 
1.440 


V 1.220 
1.267 


-.135 
-.173 




Q 3 


LS" 

c 


2.283 
2.583 


2.440 
2.467 


.157 . 
-.216 


* 


: Q 4 


LS 
C 


1.419 
1.560 


1.440 
1.600 . 


.021 
.040^ 




" Q 5 • 


LS 
C 


3.371 
3.417 


3„300 
- 3.267 


-,071 
-.015 


* 


Q 6 


LS * 
C 


3.214 
3.087 


3.109 
3.200 


-.105 
-.113 




Q*7 


LS 
C 


. 2.814 
2.565 


2.652 
2.400 


-.162 
-.165 


* 


Q 8 


* LS 
C 


• 2.650 
= 2.318 


2.222 
2.400 


-.428 
.082 ' 




Q 9 


LS 

'C • • 


1.828 
1.864 


\ 644 
1.800. 


-.064 • 




Q10 


LS * 
C 


3.288 
'3.130 


3 . 370 
3.200 


.082 
.070 




•Qll , 


LS 

t C 


2.-933 
" 2.818 


3.043 
2.933 


.110 ■' 
.115 




Q12 


LS 
C '• 


1.797 . 
2.136 


1.630' 
1.933 


-.167 
-.203 




Q13 


LS 
C 


1.5*86 

1.870 


1.500 
1.667 


-.086 
-.203 •' 





*See Table, IV- 29' for a listing of actual items. 
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Item Findings .on, the Life Skills for^ 
Mental Health Opinion Survey 



\ 



0 7. 



8. 



1. Good mental health is desirable but 
not absolutely essential for maximum . 
classroom learning. 

2. .The teaching of values has no place 

in the classroom, 

* 

3. Basic skills need more emphasis than 
Life Skills in the school today/ 

4. Affective education is riot related to 
Basic Skills. 

5. Students should be taught to share and 
~ publicly affirm their values. 

Unless knowledge is related to an af-' 
fective state in the learner, the* like- 
lihood that it will influence behavior 
is* limited. ; 

Children are generally unaware of the 
effects their unacceptable *or disrup- 
tive behavior has on others abound them. 

Telling a student how he/she should be- 
have takes sway the opportunity for the 
student tb learn 'how his/her behavior 



6. 



affects others. 



Strongly 
Disagree 



s Disagree 
Somewhat 



»LS„ 



1 - 



Agriee 
Somewhat 

3 - 



* Strongly 
' Agree 



LS „ 
< — • C 



\ 




I 



LS 



4 * 



-•LS. 



- *■ 
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Table IV-29 (continued) 



M 

r 



10. 



11. 



12. 



13, 



It is wrong to teach children to accept 
personal characteristics which cannot 
be changed. 

The way Tcnowl edge affects one's 'behavior 
'occurs only in the degree to which the 
individual has discovered its personal 
meaning for himself or herself. 

Whenever we solve, or attempt to solve, 
a problem for a student we take a 
learning opportunity away from the stu- 
dent* 

It is extremely difficult to effec- ^ 
tively integrate cognitive and affec- / 
fc tive education within the same eurricuj 
lum activities. _y * — ^ 

Children in school should be exposed 
only to those values which are commonly 
held by our own society. , 



Strongly 
Disagree 



Disagree 
Somewhat 



Agree 
Somewhat 



Strongly 
Agree 



1 


2 


,3- 


4 


1- 


1 .... 1 . 1 


1 1 


t 




<r-LS 




I 










1 

1 


2 

1 1 1 


3 

1 I 1 I 1 1 I . 1 1 


4 

1 


I 




-> C 


1 


1 

1 — — 


2 

1 ' 


3 

I l i i 1 i 1 


" 4 






•-> LS 


1 






C 




1 

1 


2 

' "I 


3 

1 1 






<— «LS 

C 




1 


1 

1 r 




3 , ' t . 


4 

1 



ERJ.C 



177 



178 



/ * 



Teacher Use of Life Skills Program 

The Life Skills For Mental Health Teacher Survey was administered to 
Life Skills teachers in order to collect feedback on the implementation 
of the Life Skills program. At the pretest, 60 Life Skills teachers com- 
pleted this survey; thirty-three Life Skills teachers cojnpletelTit at the 
posttest. In both the pretest and posttest teacher 'samples, approximately 
12 percent taught at the early elementary level; the remainder were dis- 
tributed evenly throughout the three upper levels. 

Frequency of Use . Teachers were first asked how often they used * 
mental health activities before they received Life Skills training. The 
average response was "Several times a month." Later, as^ teachers were just 
beginning to implement the Life Skills program, the average response to 
the question rose to "About once a week." Finally, at posttest, the 
rate of use was close to "Several times a week." * 

Type of, Use. Life Skills activities can be implemented in a number 
of ways. Table IV- 30 presents a summary of how the Life Skills teachers 
typically used the activities. 



Table I\T-30 4 
Relative Use of Life Skills Activities 



' Use , ' * 


Percent of Total 




« 


Pre 


Post 




' Used as Separate Activities 


27.5 


28.4 ' 




Integrated with Classroom 






* 


Lessons 


43.5" 


50.1 g 




Introduced at Reachable 






■ m 


Moments * 


26.7 


29.0 


* * 


Other % 


20.1 


26.00 


\ 
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At both pretest and posttest, about one half of the Life Skills activities 
were integrated with regular classroom lessons. Approximately one quarter 
were used as separate activities and anothe^quarter were introduced at 

* 

teachable moments. Other uses accounted for the final quarter.^ 

Use and Usefulness of Strategies . Four strategies were included as 
a part of the Life Skills training. Teachers were asked to indicate how " 
often they used thgsfc strategies and how J useful they rated these strate- 
gies. Results are presented in Table IV-31. 



/ 



' Table IV-31 

Mean Use and Ratings' of Usefulness 
for Life Skills Strategies 



Strategy 



Use* 



Listening for Feeling 
, Behavior Feedback 

o 

Role Playing 

Values Clarification 



Pre 

•3.98 
3.80 
2.02 



Post 

3.82- 
3. 34 



3.05 2.88 

■ y — 



Usefulness** 



Pre 



Post 



-3^5*8-^37-42- 



,3.29' *3.25 
2.90 / 2 ."66 
3«19 3.13 



J x 



*5 - Once a day or more, 4 = Several times a week, 3 = About 
once a week, 2 = Several times a month, 1 = Once a month or 
less. 

. « «!* 

**4 = Very useful, 3 =• Useful,' 2 = Somewhat 'useful, I = Sot at 
all useful . »* 

Listening for feeling received the highest 'level of use (several times a 
week) and the highest ratings on usefulness. Behavior feedback was 
sec£id^&n these dimensions; values clarification was third, and role play- 
ing fourth. For all four strategies, both use and perceived usefulness 
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showed slight declines from pretest to posttest, except, for one case. 
The one exception was the use of role playing, which rose' slightly from 

pretest to posttest- <9 - k 

• / 1 

g> , Perceived Program Benefits . On the Life Skills for Mental Health 
• * - — « 

Teacher Survey. Life Skills teachers also were asked to describe the 

changes they had observed in eight student behaviors since the introduc- 
tion of the program. 'Scale scores then were computed for these eight 
ratings. On the. pretest, the average overall score was 3.91, indicating 
that teachers perceived a. positive change in their students' behaviors. 
On the jjosttest, the average score was 3.90. There was no' significant 
difference in these scores from pretest to posttest (t = .07, df = 81 
P = .946). ' 



Teacher Affective Behaviors . • 

The nature of ^ teachers' affective beha^ors was observed and rated 
on tfreLife Skills for Mental Health .Classroom Observation Form . ^Section 
^ 6. Observers rated both Life Skills and control teachers on a series 
of 14 behaviors. Life Skills teachers were observed twice, once <\rin§ 
a Life Skills activity and once during a regular lesson. Control /lasses 
were observed during a regular -classroom pefciod. "Ratings on the 14 be- 
haviors were combined into scale scores arid compared using a 2x3 analy- 
sis of variance.* Results are presented in Table^ IV-32 

f The treatment group effect was found to be significant. Examination 
of the cell means shows jthat Life Skills teachers we^e rated highest on * 
affective behaviors during their presentation of Xife Skills activities ^ 
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Table IV-32 





Results of Analysis of Variance on Observation 
Ratings*' of Teacher Affective Behaviors 

• 






/ 


• 

Group r 


.Pretest 
He an 


* '• 
• S,D. 


Posttest 
Mean * 


4 

S.D. 


0 

Main 
Effect 


F 


• 

P * 


* 

Significance 


LS Activity • 


3.138 


3T 

.522 


3.118, 


,.576 


Treatment 
Group 


9.935 


.001 


** 


LS Regular _ 


• 2.891 


.579 


2.986 


.563 


Pretest vs. 1 

Postt-est 

. ,- * 


.013 


.909 


^ NS 


Control 


2.857 » 


.630 


2.676 


.562^ 










/^^Significant 


V 

at the p < 


o 

.005 level. 

<5 * «J " 






» 







m v * 
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but even during regular lessons the Life Skills teachers received higher 
tatings than the, control teachers. No significant difference^ 
ratings ykre fouijd f roto Vretestf to po^Vfes*. /" >. ' > \ 



in tfip 



'Another vatiabld frelatgd. toCaffeptive beh&^iors was therrelative -tii 

teachers *sp£nt usSiiig varipus tffodea^of presentation in the classroom. 

•jr-. 

Ob^erve^s i;ecpi;ded this information during their stay in the classroom. 

t ** * r * . . 

Findings are presented^ in Table IV-33. * 

*" * , ^ • * ■ . 

Table IV-33 

b * • • 

Percent of Time Spent in Presentation Modes 



:time 



Mode 


- Group 


Percent 


of Jime 


i 




Pre 


Post 


9 

Lecture 


LS 
C 


TOO 

.182 
.310 


.195 
.080 


Lecture/Discussion 


LS . 
C 1 


.442 
.310 


.195 
.067 


piscussion 


LS. 
C 


.442 
.262 


■ .414 
• .293 . 


Question/Answer 


LS 
C 


.364 
.405 


/ .218 
/ .187. 


Drill 


LS 
C 


.091 / 

. 262 ; 

1 ■' 

.273 " ; 
' .238 / 


.092. 
.067 


Individualized 
^Activities 


LS 
C 


.425 
v 267 


Group Activities 


LS 
C 


' . 201 ' 
" .*071 ; , 


.425 
.253 


Testing/Grading 


LS 1 > 
C 


.032 ; 
.143 • 


e»*.046 
.120 


Free Time * 
Other 


) LS 
C 

LS 
C 


\ . 

.039 
.095- 

.299 
.190 


.080 
,i .040 

.241 
* .160 
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The amount of lecture decreased considerably from pre.test to post- 
test in control classes, ^nd^ the amount .qI lecture/discussion decreased 
from pretest to posttest in both Life Skills and control classrooms. 
However, the amount of discussion was consistently* higher in Life Skills 
classes. There also was a notable decrease in the amount of question/ 
answer activities in control classes. 

Individualized activities increased in Life Skills' classrooms, and 

the time devoted to group activities increased in both -control and tife 

• / 

Skills classrooms. 1 



Summary . 

The teacher outcome 'findings reveale^ positive^ result's on a number 
of dimensions related to program impact . Wirst, ,the fretf^cy of use of 
mental health activities among Life .Skills "teachers increased from sev- 
eral times a month, before training to" several times a week bylthe^ time 
of posttesting. A consistent increase in frequency of use could be 

* • v _ \ » 

observed from before' training to pretest to posttest. / 

Of the Life Skills activities used, approximately 50 percent were 

integrated with classroom lessons, a high priority goal of the Life 

Skills training. About 25 percent were used as separate activities and 

another 25 percent were introduced, at teachable moments. 

Four strategies also ifrere introduced in the Life Skills training. 

•" ' — % 

Generally, at both pretest and postteet, .Lif e Skills teachers rated these 

strategies as useful- J"he teachers indicated that they included listen- 
ing for. feeling, behavior feedback,, and Values clarification in their 
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classroom activities from once to several" times a week. Roie playing was 

v , • • * 

used several times a month. . 4 # 

When asked to describe changes they -had observed in their students 1 

v - • 

behaviors since introduction of the Life Skills' program, teachers rated 
these changes as positive, but little difference occurred in these rat- 
ings, from pretest to posttest.- 

Perhaps the most encouraging results on teacher outcomes were founJ 

... 0 • 

in the area of teacher affective behaviors. When rated by classroom 
observers on 14 affective behaviors related to classroom climate, Life 



Skills teachers received significantly higher ratings than control teachers 
Thes^ affective behaviors relate directly to the stated goals for the 
Life Skills program, V. 
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CONCLUSIONS 



Results of the Life Skills for Mental Health Evaluation Study have 

been discussed* in the previous chapters. 'Both process and outcome evalua- 

** • _ , 

tion findings have been presented. The process evaluation focused on 
documenting program development and monitoring implementation, while 6 thp 
'outcome evaluation examined the impact of the' Life Skills program on its 
l^^rticipantsv ^.In this chapter, the ^inal conclusions of the -evaluation 
'Will be predated, and related to implication^ ,for, , thereon tittued develop- 

*v . •» • - N " # 

ment of the Life Skills^progr,am. • • m 



Process Evaluation 



Five major conclusions resulted ^rom the process evaluation findings. 



Each is discussed in detail in the folio 



*fcijjg' / parag 



paragraphs. 



• The Activity Guides are successful teaching instruments 
which motivate teachers to -try the Life Skills activities 
in their classrooms. 



' The .Activity Guides wer6 originally developed, through a collaborative 

effort of the Office of Prevention staff and the Joint Coordinating Com- 

mittee. These Guides then were used as one of the major components of 

the*training workshops and a primary source of material for 'teachers 

implementing th^^ife Skills program. They were later reviewed by a Con-, 

sumer Evaluation Panel, composed of teachers who had implemented Life 

Skills activities in their classrooms. 
• v 

The Evaluation Panel results indicated "that the Guides were well 
- • . • \ • 

written, relevant, fea>e*^le for c^as'sroom use, an^i valuable as teaching 
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instruments. The teachers felt that the Guides motivated teachers tio 
try the activities and that* the activities^were well received .by* "students 



The Evaluation Panel "s primary suggestion for improving the Guides was 

^to* add 6 a>Key topic Index which would help teachers # to quickly locate*,. * 

• a . it* 

activities that deal Kith similar issues. However, overall, te^cfiers 

reacted very favorably to the Guides.., 

* • The Training *pf Trainers Workshops ari successful in their 
*• attainment of objectives, in meeting participant expeota- * 

tions, and in providing opportunities for involvement anH 
a participation. . * * 



•a 

Training of Trainers Workshop^ were conducted to provide instruction 
to CMHC staff for trairfing- tteachers. in the^JLfe Ski As prdgrp.* Th^ 
C^C jar t ic jlpan tg^jiomp Lkted^ evaluation f aims -at the encUof ^eaeh vorkshep 
to rate it on a number^of variables. J * 

Participants generally felt ""that all objectlv^ had been achieved 
successfully, and that content areas covered in the workshops were infor- 



mative. They .indicated that the workshops nfet their expectations, and 




that ample opportunities were provided for involvement and participation. 

Participants 1 only objections to the workshops focused on two areas: 
lack of preparation for dealing with' school districts and the absence of 
follow-up workshops and technical assistance. Methods for alleviating 
these problems will be discussed in a later section of this chapter. 

: \ • 

• Thfc Training oi Teachers Workshops are successful in their 
attainment of objectives >^nd in motivating participating 
teachers to employ the Life Skills activities and strate- 
gies in their classrooms. 



" 4 • . 

% • ■ • 

Training of Teachers Workshops were conducted by CMHC trainers to 
pregare tea.chers to implement the Life Skills program in their classrooms. 
Participating teachers completed evaluation forms at the end ftf each work- 
shop, and they later responded to a follow-up survey on the training 
workshop and of their subsequent use of the Life Skills program. 

Data from these sources indicated that the teachers felt the work- 
shop had v attained its objectives and* that the workshop had motivated them 
to employ the Life Skills activities and strategies in their classrooms. 
Most were using the activities* once a week or more, were employing 
the activities in a variety of ways, and felt the Life Skills acti- 
vities were as effective as or more effective than similar mental 

« 

health materials. The teachers also noted an increase in their use of 
the four Life Skills strategies. ' $ 4 

Participants felt that they r\eeded more help in integrating the 
Life Skills activates and strategies with their lesson pians and class- 
room /con tent*. IMany suggested that follow-up workshops would-be useful. 

• The^molti-level training and implementation system used' to 
organize and administer the Life Skills program is rela- 
tively successful in accomplishing its objectives and in 
y * establishing good working relationships among the various 
agencies involved. 

The coordination of" the implementation of the Life Skills prograr. 

. revolved around a multi-level system, starting at the state level with 

the Department of Education and the Department of Human Resources (DHR) 

then filtering down through state level, trainers and local trainers^ 

finally tq reach teachers in the local schools. In such 'a system, 



r 
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opportunities for misunderstandings and interagency problems are great, e 
yet the Life Skills implementation system has successfully>^voided most 4 * ^ 
of these potential (pitfalls . A good working relationship between DHR, 
the Department of Education, and local agencies was esta^Sked^early . 
As training began, special efforts were made to establish il-nkages amWg 
all levels of trainers. On the local front, CMHC staff reported increased 
communication with other CMHCs in the state and with local school dis- 
tricts. 

• The success of the system in gaining cooperation of the CMHCs and 
• f 

ini transmitting information about the Life Skills program is evident 




from its results, twenty-five of the 34 CMHCs in Jffie statPof Georgia 
were participating in the Life Skills program during the three yea**, 
evaluation, and as evidenced by previously discussed findings on the 
Training of Teachers Workshops, teachers were enthused about the, 
and were using the activities and strategies in their classrooms! ">trteA- 
views with DHR and Department of Education representatives reinforced" tHe 
optimistic outlook for "the .program. ! * , f 

_ Although the multi-level training system was quite successful in 
accomplishing its. purposes, some difficulties did ekist. .Among these, 
the one of most concern was ttfe establishment of initial linkages between 
CMHCs and local school districts. After CMHC staff had been. trained by •* 
state level trainers, they often were very slow in gaining acceptance © 
in the school districts .and beginning workshops for teachers. CMHC staff " » 
lacked confidence in this area and noted the nee'd for more technical \ * '* " 
assistance to aid in solving these problems. ' • 
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• To most effectively implement the Life Skills program, a 
monitoring system and follow-up technical assistance plan 
are needed as standard elements of the implementation system. 

Communications with the training teams and responses on follow-up 

evaluation questionnaires revealed several areas in which both trainers 

and teachers were encountering difficulties. After initial training, 

. 'X 

nn v 



many CMHC training teams lacked confidence in their ability to trad 
teachers and to establish 'contacts with^&bqfl districts in order to 
schedule workshops/* The lack pf an established system for monitoring 
the activities of/training teams and of school districts which had 
adopted the Life Skills program compounded these problems further. 
Teachers |Kio had been trained in Life Skills reported the need for fol- 
low-up workshops which could ^be used to discuss classroom implementation 
problems and to concentrate on activities and strategies that needed 
clarification. 

In an effort to resolve some of these problems, several steps were 
taken during "th e co urse- &f -the 'evaluation -s-tudy^ — Individual -eval u a ti ons__ 
of selected workshops were conducted by RBS staff, a management informa- 
tion system was adopted for tracking teachers trained and school dis- 
triots, adopting the program, and follow-up workshops 'were conducted when 
possible. Although these efforts provided immediate response to some 
difficult problems, a more systematic approach is needed to insure — 
continued effective implementation of the program. 

Perhaps the best approach for insuring effective implementation 
would be (1) to continue or expand current monitoring activities and 
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(2) to provide more follow-up technical assistance". During 'the three ^ 
years of this study, monitoring activities have included workshop evalua- 
tions and documentation of teacher and school district involvement. 
It is suggested that these activities be continued and perhaps expanded 
to, include more in-depth monitoring of school di$£jrict involvement 'and ' 
of the linkages between the CMHCs and school district personnel. It" 
also is suggested that .documentation of participant involvement be / 
centralized so that the ,inf ormation is readily accessible foj/ later use. ' 

Regarding follow-up technical assf stance, a number of possibilities 
exist to aid both teachers and trainers. One would be to increase the 
availability of follow-up workshops; another ,would be to establish a 
statewide network o'f trained personnel available to answer questions re- 
lated to the Life Skills program; yet another approach would be to'pub- 
lish a newsletter on Life Skills activities which includes a special 
column on problems encountered and suggestions for^solving them. - 
Other possibilities exist. The important thing is to provide teachers 
and trainers with the maximum amount of support available in order to ; 

help them in implementing the Life Skills program. 
» 

^ Outcome Evaluation 

Four major conclusions were drawn from the findings of the outcome 

i _ 

evaluation. Each of these is discussed in detail below. 

S • The Life Skills program was effective in reducing disrup- 
tive behavior and increasing positive teacher and-^tudent 
affective behaviors. 
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On the two variables related most closely to the Life Skills 
objectives, affective behaviors and disruptive behaviors, ' the Life 
Sibils program produced positive impact. Regarding affective-behavior, 
students' and. teachers were independently, observed and rated on a series ' 
of affective behaviors linked to the objectives of /the Mfe Skills -pro- 

gram. t Results showed that Life Skills students^were rated significantly 

« * < 

higher than their control counterparts and that ratings for the Life 
Skills students increased significantly from pretest to posttest, while 
the control grpug ratings showed no increase during, that time period. 
For teachers, the affective behavior ratings showed the Life Skills 
teachers, to be significantly 'firore affectively otiented than the control 
teachers/ 

Regarding disruptive behavior, teacherVtftings showed significantly 
more changes toward less disruptive behavior from the pretest to the 
posttest for Life Skills students than for control students at the early 
elementary and upper elementary levels. Differences were not significant 
at the intermediate or high school levels. 

These findings on affective behaviors and disruptive behaviors show 
some very positive effects of the Life Skills program. Both teachers 
and students were rated significantly higher on affective behaviors than 
their control counterparts. Since these behaviors are so closely tied to 
the Life Skills program objectives, these results provide direct evidence 
that the life Skills program is achieving its stated objectives. Simi- 
larly, the reduction of disruptive behavior is a high priority goal of 

' \ 
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the Life Skiljjs program. The positive results at the elementary levels 

suggest that/tWfe 'Life Skills program ma^ be especially effective when 

introduced in the early t grades . 

• Minimal support for effects of the Life Skills program in 
inc reas in g\ student self concept, interpersonal skills, 
classroom dlimate, or attitudes toward school was found 
in this stuiiy. 



Although occassional significant differences were found on some of 
these variables, 4 no^clW pattern emerged favoring either the Life Skills 
or the control group. Overall, the results did not /arrant any conclu- * 
sive statement on treatment effects relevant to tffe above variables; 

One possible explanation for these 0 findings is the relatively short 
exposure of students to theWfe Skills program. 'Were the intensity and 
length of program exposure increased, patterns of differences on these 
variables might be more distintt. 

• No evidence of support for effects of the Life Skills pro- 
gram in 'reducing drug or\ alcohol use was found in the 
study * * 

The Life Skills program was designed as an affective education pro- 
gram, foct^ing on intrapersonal andVnterpersonal skills, The program 
does not iiteke any special effort to address drug and alcohol abuse, 
although teachers may occassionally'indlude activities on this topic. 
Thus, any reduction in drug and alcohol bbuse among Life Skills s-tudents 
would be an indirect effect of the prograA, attributable to students' 
increased ability to define their value structures and/or to deal with 

\ V 

stressful situates. Since the reduction oV drug and alcohol abuse is 
an indirect effect of the program, it .may 'be ^xpected to be a long-term 
effect rather than a Short-term one. 
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• Previous findings on frequency of drug use and in differ- 
ences between the sexes on. drug attitudes and drug use 
were replicated. » 

Results of thisevaluatioif showed significant increases from posttest 

I to posttest II in specific types of drug and alcohol'use at all three 

levels at which these variables were measured— upper elementary, interr 

mediate, and high school. These increases were evident in both the Life 

Skills and control groups, and they seem to follow a national trend of 

increasing alcohol and drug use at *11 age levels (Johnston, 1980). 

Findings on differences between the sexes also agreed with Johnston's 

findings,: males tended to have a higher tolerance in their drug . 

attitude scores, and higher predicted levels of drug use. As ^.n most' 

previous studies, ethnic group jwas nor a significant predictor of drug 

and alcohol use.* , 1 * 



\ — 
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- . APPENDIX .A 
PROCESS EVALUATION MATERIALS 

4 

TRAINING OF TRAINERS WORKSHOP EVALUATION INSTRUMENT • 

TEACHER TRAINING WORKSHOP EVALUATION INSTRUMENT 

LIFE SKILLS TRAINING WORKSHOP ATTITUDE CHANGE MEASURE" 



LIFE § SKILLS /OR MENTAL HEALTH EVALUATION PANEL QUESTIONNAIRE 
SUMMARY OF CONSUMER EVALUATION PANEL 'FINDINGS 



.LIFE SKILLS FOR MENTAL HEALTH TRAINING WORKSHOP REGISTRATION 
FORM 



LIFE SKILLS FOR MENTAL HEALTH FOLLOW-UP SURVEY ON TEACHER 
TRAINING WORKSHOP 



SPRING 1979 RESULTS OF FOLLOW-UP SURVEY ON TEACHER TRAINING 
. WORKSHOP 
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. 1 LIFE SKILLS FOR MENTAL HEALTH 
TRAINING Of; TRAINERS WORKSHOP 

/ 

* As. 

WORKSHOP EVALUATION , . 1 

Age: under 25 ' 25-34 35-45 1 over 45 . ' 

Education: degree - , years toward advanced- degree 

Field: — Mental Health — Education Other (specify)' 

i 

(* » Years experience in present or related fields: 

A. ATTAINMENT OF WORKSHOP OBJECTIVES 

The planned objectives for this workshop are listed below. Please circle the numfc>er which indicates how 
well you feel each objective was attained. • . 

« 

Very * Very Un- 



< very 

Objectives :*- ^ , , Successful Uncertain 



successfut 



1. To increase understanding of the importance of affective 5~"\^-4-v_ *3 2 1 
education; 

» 

* ^ * •* 

2: To increase understanding of the relationship between 5**4, 3 ^2 1 

affective ancJ cpgnitive learning. • * . 

3. To reinforce the rationale for promoting positive affective '5 ,4 3 2 1 
k and cognitive growth as a prevention strategy in mental , 

health. * . 



4. To introduce and demonstrate selected classroom activities \ 5 
in the Life Skills Program. 

5. To facilitate trainers 1 personal knowledge and skill in Life 5.4*3 2 
Skills Strategies, 1 ' 

» • » 

6. To develop and/or increase trfeiners' confidence in their 5 4^ v3 2 
ability to conduct Life Skills teacher inservice workshops. ' % * 

7. To provide resources for additional training, consultation 5 4 3 % 2 > 
and materials. ^ ' 



B. TEACHING TECHNIQUES . * 

Please circle the numberv/hich indicates, in your opinion, the effectiveness^ each technique. How well did 
- eacfh technique facilitate ypur learning?* 

( I * • 



1. Lecture 

2. Group Discussion 

3. Skill practice exercises: 

a. Listening for Feeling 

b. BehaVior Feedback 

c. Values Clarification* 

d. Role-Claying 

e. ' Developing Lesson Plans 

j 

4. Slide/Sound Presentation 

5. Handouts ♦ 



Very 
Effective , 



Uncertain 



Very In- 
effective 

1 



5 - 


i 4 


3 


2 


1 


5 . 


4 


3 


2 ■ 


/ 
1 


5 


4 


s 3 


2 


1 


5 


w 
4 


3 


.2 


1 


5 


'4 




2 


'1 


5 


4 


.4 


2 


1 




.4 


3 


2 


- 1 


5 


4 


- 3. 


2 


1 



C. CONTENT 



n mucjhdid y 



Please circle thd number which indicates 6ow informative you found each topic. That is, how mugn did you 
team about each? If you werQ familiar with the material and therefore didn't learn much that was new, please 
check first column. 



1. - Rationale and Objectives of 
Life Skills Prdgwrr 



ERLC 



2. 
3. 
4. 
5., 
6. 

7. 

8. 



Listening ter Feeling Strategy 
Behavior Feedback 
Values Clarification 
Role Playing 

to 

Demonstration of Life Skills 
activities 

Explanation of Affective 
Integration 



Developing Affective inte- 
gratedv lesson pjlans 

9. Evaluation of Life Skills 

X. 

10. Guidelines .and format for 
teacher inservice 

11. pps for Trainers 



Already' 
Familiar 



Very 
Informative, 



5 
5 
5 
5 
■5 



\ 
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5 
5 

5 
5 



4 
4 
4 

,4 
4.. 



Uncertain 

3 
3 
3 

3 • 
3 



4 

f 

4 

4 
4 



3 
3 

3 
3 



2 
2 
2 

-2 

^2 

2 
2 

2 
2 



Very 



Uninfoi 



mative 



D. EVALUATING THETOT^U^X^ERIENC^ 
1. How do you feel about the workshop? 



Very Pleased • ' . Uncertain % very pispleased 

5 4 3 2 1 

■ 2. TB what extenj was the workshop successful in meeting your expectations? 

Very Successful ^ Uncertain Very Unsuccessful 

5 - 3 %< 2 , 1 

Comments: % 



3. How satisfied were you with the opportunity for participation? 

i 

Very Satisfied Uncertain , Very Dissatisfied ' * 

5 4 3 2 

* » 

v. * 

Comments: ^ , - 

i 



) . 

i 

4. What was your major reason for coming to the workshop? 

5. a. What one aspect of the workshop was most helpful to you? 



b. Was there one aspect that was least (or less) helpful? If so, what? And why? Please describe 

\ . 

6. How much of the material presented in the workshop will be helpful to you as a classroom teacher? 

* » 

—Mil _Most * _Some None , ^ 

/? ' nr^hL^r^^ <*, uld h3Ve beeri impr0ved t0 have made !t a richerlearningexperienceforyou' 
or to have better prepared you, to conduct the Life Skills inservice workshop for teachers ° ry ° U ' 

i •» . , ■ ' ^ 

8. What other topics or issues would you like to see addressed in future workshops? 

9. What comments do you have about the general structure of the workshop? (Consider facilities number 

of people, length, amount of material covered). V°" ac "' l| es, numDer 

c d w- 10 *- General ^ omments or suggestions. (Use back of page if yo\j need more space' ) 



1 



E. EVALUATING THE .WORKSHOP LEADERS 

I?eas' P US ' mpr0Ve ° Ur J^2!£^9 skills, please evaluate the wjjkshop leaders in each of the following five 

1. Preparation: Was trainer prepared for his/her presentation? 

2. Knowledge: DidVainer convey understanding of the ionteht of his/her presentation? ' 
3 Skill> Did u\iner model the skills being taugtjtj? * ' 

, 4. Application: Did trailer convey an understanding ol f Application of skills to'the classroom? . * 
5. Effectiveness: How effective was trainer's style in facilitating your learning? * * 

I 

Please rate each trainer Independently (not in comparison to; other trainers) on a scale of 5 (high) to 1 (low). 



RATINGS 



1 . Preparation 

2. Knowledge 

3. Skill 

4. Application 
5/ Effectiveness 



name 



name 



name-' 



name 



Please offer suggestions which you"feel will help specific trafners increase their effectiveness (You may use % 
Behavior Feedback statements. Use back of page if you need more space.) 



V 



ThX^KS^OHJQUR PARTICIPATION! 
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LIFE SKILLS FOR MENTAL HEALTH 



TRAINING WORKSHOP EVALUATION 



School System ... 

Sub|ect/Speciaity Area 

No of Years Teaching Experience 



: Date 

Grade Level .... 
L 



A ATTAINMENT (^WORKSHOP OBJECTIVES 

The planned objectives for'this workshop are listed below. Please circle the number which indicates 
well you feel each objective was attained. 



lOW 



Objectives 



Very 
Successful 



Uncentain 



1 To create an awareness of the importance of affective 
education 




Very un 
successful 

r 



2, To increase understanding of the relationship between 
affective and cognitive learning. 

3 To create an understanding of t»Ve rationale for promoting 
>• positive affective and cognitive growth as a prevention x 
, strategy in mental health. 



^sjr To introduce and demonstrate selected activities in the 
Life Skills Program. *. , ■ 

5 To facilitate personal knowledge and skill in 'the -four 
Life SkiHs Strategies. , 



*4 



6 # lo develop and/or increase personal confidence in the 
ability to conduct Life Skills activities. 



1 To provide resources for additional training, consultation 
and materials. * : * 
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B. TEACHING TECHNIQUES [' ' - - 

Please circle the number'which indicates, in your opinion, the effectiveness of each technique. How well djd 
each technique facilitate your learning? t / • 



1 Lecture 

2. Group Discussion 

«3. Skill practice exercises: 
~a Listening for Feeling 
b Behavior Feedback - 
c. Values Clarification ,, 
c. -Role-Playing 
• e. Developing Lessdn Plans 

4 Slide/Sound Presentation 

5 Handouts 



Very 
Effective 

9. 

5 • 



5 
5 
5 
5 

,5 
5 



■< 
4 

4 
4 
4 
4 
4 

4 

4 



Uncertain 

3 
3 

3 
3 
3 
3 
3 

3 

3 



2 
2 

2 
2 
2 
2 
2 

2 

2 



Very 
In effective 

1 

1 



C CONTENT f • 

Please circle the number which indicates how informative you found each topic. That is t how much did you 
learn about each? If you were familiar with thematerial and therefore didn't learn much that was new, please 
check first column. 



Already 
Familiar 

/ — i 

1. Rationale and Objectives of 

Life Skills Program 

2. Listening for Feeling Strategy " 

3 Behavior Feedback : m 

4 Values Clarification 

5 Role Playing a m • 

6. Demonstration of Life Skill? 

activities 

7 Explanation of Affective 

Integration « , 

8. Developing Affective inte- 
grated lesson plans « . _ ' 

9. follow-up services/resources L. 



Very 
Informative 



5 
5 
5 
5 
5 



5 
5 



4 
4 

, 4 
4 



Uncertain 

3 
3 
3 

3 ■ 
3 



Very 
Uninformative 



4 " 3 
4 ■ 3 



2 
2 

2 
2 



? 

2 



D. EVALUATING THE TOTAL EXPERIENCE 
1. How do you feel about the workshop? 

Very Pleased Uncertain ' ' Very Djspleased 

5 , 4 3^2 1 

2 To what extent was the workshop successful in meeting your expectations? 

• Very Successful v Uncertain ' Very Unsuccessful 

5 ' 4 ' ' 3 2 y 1 ' 

, 3. How satisfied were you with the opportunity for active participation in the workshop activitives? 

Very,Satisfied Uncertain very Dissatisfied 



♦ 3 2 1 



4. How informed do you now feel about the Life Skills program? 

Very Informed Uncertain' Very Uninformed 

5. How comfortable do you now feel with your ability to implement and conduct the Life Skills program? 

Wfy Comforabl * • Uncertain . V ery Uncomfortable 

/ 5 - 4 3 2 1 

/ , .... 

6. What was your major reason for coming to the workshop? 



* 



7. a. What one aspect of the workshop was most helpful to you?^ 
i " * 

. b. Was there one aspect that was least (or less) helpful? If so, what? And why? Please describe, 

8.. How much of the material presented in4he workshop will be helpful to you in your profession? • 
— All ' __ M ost _Some _L N one' 

k 

9 ' ldl W hf J*! 6 worksn °P c ° uld have ^en improved to have made it a richer learning experienced vou 
or to have better prepared you to use the Life Skills program. * '««""'"9 experience rotyou, 

10. What other topics or issues would you like to see addressed in future workshops? 

f 

12. General Comments or suggestions. (Use back of page if you need more space.) 
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EVALUATING THE WORKSHOP LEADERS 



\o help us improve our training skills, please evaluate the workshop leaders in eacn of'the following five 

3T63S ' * 



/ 



J 



4 ' ' S 

1 Preparation. Was trainer prepared for his/her presentation? 

2 Knowledge- Did trainer convey understanding of the content of his/heVpresentation? 

3 Skin ' Did trainer model the skills being taught? 
4^ Application Did trainer convey an understanding of the practical application of the skills taught? 
5 Effectiveness How effective was trainer's style in facilitating your learning? 

\> 

* Please rate each trainer independently (not in comparison to other trainers) on a scale of 5 (high) to 1 (low) 



1 Preparaiion | 

2 Knowledge 

3 Skill 

4 Application 

<3 Effectiveness <• 



RATINGS 



*AT, 



name 



name 



name 



name 



)u feel 



Please offer suggestion* which you feel will help specif.c trainers increase their effectiveness (You mav 
use Behavior Feedback statements.) 1 ! c "*" lv F ness ' t y ou may 



THANKS FOR YOUR PARTICIPATION' 
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Name : 



LIFE SKILLS FOR MENTAL HEALTH 
TRAINING OF TRAINERS WORKSHOP 

JULY 40-12, 1978 

A ge: jJnder 25 * 25-34 3 5-*5 over k$ 

'Education: [degree years toward advanced degree 

Field:- _^ Mental Health Education Other (specify)^ 

Years experience in present or related fieldsK ' 

-» 

The following statements represent commonly held opinions in the fields of educa- 
tion and mental health. Since these are only opinions, there are no correct or 
incorrect responses possible. For each statement below, please check the response 
which indicates most closely the extent to Which you agree or disagree with the 
opinion stated. * 

1. Counselors are more responsible than teachers for the njental health of ■ 1 
-studenfe. j) 

* 1 . .2 3 '4 

Strongly Disagree Disagree Somewhat Agree Some&hao Strongl.y Agree. \ 



2. Good mental health is desirable but not absolutely essential* for maximum >; 
classroom learning. 1 

1 * 2 e t ^ 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



. < 



3. The teaching of values has no placte in the classroom. 

, • - . 2 s .- - - , • r 

-^Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



*K .When children are taught to express feelings, they can lose control. f 

' • 2 < ' 3 * M 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree f 
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\ 

.Basic Skill's need mofe emphasis than Life Skill ^ i n the .schools today. 

k r \ 2 " ' ^3 , k 

Strongly Disagree Disagree Somewhat Agree Somewhat Strong! y .Agree 



• The time spent in school each day is -pot enough to change anyone's behavioY. 

f ' 2 - ^ 3 k 

Strongly Disagree Disagree Somewhat Agree Somewhat StrcJhgl y ./Agree 

s 



Affective education is not related to Basic Skills. 

• 1 2 \ 3 * k 

Strongly Disagree Disagree Somewhat Agree Somewhat Strgngly Agree 

- 4 

1 • 



Life Ski Ms is best taught a$ a. separate course and not integrated with 
other content areas. 

1 * j 2 — * 3' 4 

Strongly Disagree* Disagree Somewhat Agree Somewhat Strongly Agree 



Students should be taught to share and publicly affirm their values. 

1* • ' .2' 3 , ^ 

Strongly Disagree,, Disagree«Somewhatf Agree Somewhat Strongly Agree 



Students should be taught % to.act upon their values'. 



2 3 . k 1 

Strongly Disagree Drstfgree Somewhat Agree idmewhat' Strof^Hy Agree- 



The cognitive and the affective are completejy different realms and evolve 
independent ty and uniquely within each individual. v , 

♦ > • - \ J* 

J ' ; 2 3 • - 4 ? 

"SUungly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 
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12. 



Unless knowledge is related to an affective state in the learner, the 
likelihood that it will influence behavfor is limited^ V 
* 1 <• ) 

Strongly Dfsagree. Disagree Somewhat Agree Somewhaf Strongly Agree 

• • f 



4- 



13. 



^^•^"k^ 6 ? enera "y ""aware of the effects the i r Unacceptable or dis- 
rupt, ve behavior has on others aroynd tfem. • 

1 ' 2 ' ' 3 * 4 

Strongly Disagree Disagree. Somewhat Agree Somewhat Strongly Agree 

— » j 



14. 



15. 



16'. 



4 



Disruptive behavior 'when dealt with in a punitive way, often increases. 

1 2 3 »' v. i, 

Strongly, Disagree Disagree Somewhat Agree Somewhat Strongly Agree 

" ■ *■ . 

Telling a Student how he/she' f sh'ou Id behave tikes away the. opportunity IfoK 
the student to learn how- hi s/Jier" behavior affects others. * \ 

i * • 

* 2 3 2j 

Strongly' Disagree Disagree Somewhat ^Agree Somewhat Strongly Agree 

• '. — ; a 

It is nearly impossible to encourage behavioral change without risk of 
Wl^''' ""-^«pt, on to the teacner ^reiationsn'p 

i . 2 • "' > ■ °z I k 

'Strongly Disagree" Disagree Somewhat Agre& Somewhat Strongl/Vee 

_ — ' y . / - 



17, 



Students should be taught to choose their values from among varied alterna- 
Strongly Disagree. Dis^e Somewhat Agree SomewhaT^-Strongly Agree 



:RLC 
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The teaching of personal values should be relegated tp the home and not 
the schools. 

1**2 3 h 

Strongly Disagree Disagree Somewhat AcH*ee Somewhat Strongly Agree 



v 

It is wrong to teach children'to accept personal characteristics which 
cannot be changed. 

1 2 3 / * 

Strongly Disagree Disagree Somewhat Agree Somewhat/ Strongly Agre£~ 



A function of the schools should be that of preparing students to deal with 
conflicting and changing values and to be able to Ifiake their own value 
deci s ions . 4 

1 2 3 k V 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 

— ^r- —, : 

The way knowledge affects one's behavior occurs only in the degree to which 
the .individual has discovered its personal meaning for himself or herself. 

1 2 ' 3* > - k • - . 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



It is important to openly express feelings, to others rather than camouflage 
them. , ... 

r 1 - 2 3 * k 

Strongly disagree Disagree Somewhat Agree Somewhat Sfrongly Agree 



Whenever we solved or attempt to solve, a 'problem for a student we tak^ a 
learning opportunity away from the student. 

-*>.': 2- 3 ^ k ) 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 
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A person who is unsure or unaware of his own feelings and values wilj not 
be successful in. solving his own problems or in leading a productive 
satisfying 1 i fe. * . ^ 

*1 ' - 2 ' 3 ' k 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



Tfiere are some school subjects today that can be taught as either having 
cognitive or affective cont^JU^*"^ 

J -2 3 : \ 

Strongly Disagree .Disagree Sfimewhat Agree Somewhat Strongly Agree 



Teaching in the ^cogn i t i ve area is a more important role fdr the schools 
than te|chirig in the affecth/e area. 

I ' 2 3 2, 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



It is extremely difficult to effectively integrate cognitive and affective 
education within the same curriculum activities. 

% 1 2 3 k 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 

. . ,»? 

It should not be the role of the school to* encourage students to openly 
express feelings and values which are of a personal nature. 

1 2 3 ; 2, - 

Strongly Disagree Disagree Somewhat A^ree Somewhat Strongly Agree 



Children in school should^be exposed on*ly to those values which are ' 
commonly held by our own society. 

1 • . ■ 2 3 k 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree' 
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LIFE SKILLS FOR MENTAL HEALTH EVALUATION***^ 



PANEL QUESTIONNAIRE 
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EVALUATION PANE! > * - 
* LIFE SKILLS FQR* MENTAL HEALTH PROGRAM 
^October 2&; 1978 * 
^ Macon, Georgia' 



Name 



Sex 



Adtiress (business) 



Phone? 



(Home) 



N 



Phone: 



School System 



Subject/Specialty Area 
Grade Level x .. / 



N * 



Levels of Leader's Guicje Used 
Age a under 25 * 25-3V 



s - 



Education 



under 25 



35-^5 



over. ^5* 



Years Experience* in Present Field • 
Date Trained in Life Skills Prograrrt 
Where Trained in Life Skills Program ' \ 



4 



V/hy did you decide to participate in the Life SkiHs Training? 



O 





0 > -. 




* 






• " . <T - ■ 


V 

w 


< • 

- , A- ■ r t-., _ 



Your "CSbpe ration and participation in^h'is Pane) session is 
greatly appreciated. The views^and opinions of the practition- 
ers in education are' critical to the impl emefitat ion^ of any inno- 
vative program. Your involvement in this effort at evaluation 
of the Life Ski 1 1 s . Guides v/i 1 1 provide information essential to 
the future qu t a)ity £jnd utility of the Guides. 



\ 
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OVERALL PROGRAM USE 



(1) How did you initially use'the Life Skills Activities Guides in the 
classroom? 



(2) How do' you use the' Guides now in the classroom? 



Where do you keep your c^y of the Guides? j k 



V 



7^ 
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OVERALL PROGRAM USE (continued) 



What kinds of problems have you encountered? n implementing the 
Guides?. 3 



What have been the reactions of students, parents and other teach 
to your use of the Guides? 



How would you evaluate the overall benefits derived by students 
from the activities in the Guides? 
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1 1 • MTIO^ALE 

Directions: This section of the questionnaire asks you to Indicate the * 
extent to which you agree or disagree v/i th'- var ious basic 
assumptions upon which this program is based. Circle the 
number indicating your opinion. 

* if* 

5 = strongly agree, 4 * agree, 3 = no opinion, 2 = disagree, 
I = strongly disagree 

I. The school 'is a partner in, fostering 5 ' k 3 2 1 
a child's total growth (i.e., emo- 
tional as well as cognitive). - J 

Comments : 



It is appropriate to spend time dur- 
ing the school day to hel.p kids learn 
about themselves and explore situa-* 
tions they are likely to face in life. 
Comments: 



3. The rapid change and high mobility in 
our society has made it difficult for 
young people to understand themselves 
and others and to develop a clear set 
of values-. 
Comments : * 
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RATIONALE (continued) 



Hany young people have a hard time 5 
understanding or expressing their 
feelings productively. 
Comments: 



It is important for kids to respect" 5 
the needs and feel i.ngs of others as 
important and to develop satisfying 
interpersonal relationships. 0 
Comments: 



V/hat 1 do with Life] Ski lis in the 
classroom ?s different from what 
counselors do with individual stu- 
dents v/ho have problems. 
Comments: - j ; 




III, FORMAT . 



Directions: On the scale pertaining to each statement, circle the number 
which indicates your opinidn. The middle number Is a neutral 
response, r j 

1. How artistically appealing Is 5 3 2 / V 

the Guide to you?, very ^ 4 1 ^ very 

Comments : appeal i ng unappeal ing 



2. How well do you think the van- 5 ** 3 | 

ous sections of the Guide fit y4ry wel 1 1 J_ not ^/el 1 

together? at all 

Comments: ^ 



x 

3. How easy .is It for you to find 5^321 
activities you want in the very eas^ T 1 h Vefy~* 

Guide? * difficult 

Comrnen t s : m 



k. How appropriate do you find 5 J * 4 3 2 I ^ 

the order of presentation of H 1 \r~ *~ 

materials in the Guide? * very * . very 

Comments: , appropriate inappropriate 



5 # How useful do you find the 5 . 4 3 2 I 

Guided Table of Contents in -+ H 1 " 

finding areas you wish to use? very useful not useful 

Comments: v at all 
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FORMAT (continued) 



6. \\ow important do you consider 

the graphic, rtlustrations to Tr 
the Guide Is use? very 
Comments : important 



5 



+ 



I 



very 
unimportant 



7 '< Ho*/ useful do you find the 
Helpful Notes Section of the 
Guide? 
Comments: 



very useful 



1 



+ 



not useful 
at all 



8. How useful do you find the 

Additional Readings "section of 
the Guide? 

^^/Cpmments : 

. / 



very useful 



I 



1 — 

not useful 
at Ml 



9- To what extent do you think the 
activities fall under appropri- 
ate categories (i.e., seTf, 
others, feelings)? 
Comments: 



-f- 



very 
appropriate 



1 



h-r 

very 
inappropriate 



10. To v;hat e\tent are the goals 
and objectives of each section 
'helpfuj to you in understanding 
each section? 
Comments: * % 



+ 



+ 



very helpful 



4- 



not helpful 
at, all 
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IV. CLARITY OF THE TEXT 



Directions: On the scale pertaining to each statement, circle the number 
which Indicates your .opinion. The middle number is a neutral 
* " response, 

1. How well does the Guide explain 5 h ~ 3 A ] 



i h 



the purposes of the various . -i \ h 

^ cUvIties? vecywell ' very^orly 

Comments: " 1 



2. How adequately do instructions 5 k * 3 2 1 

for the various activities pre- h \ \ \ \ 



pare you and $he students for very very 

the Life Skills experiences adequately Inadequately 

you use? ; H V y 

Comments: , ^ \ 



How would you rate activity 
instructions in helping carry 
out the Life Skills experi- 
ences you choose? 
Comments : 




2 

-I 



very low 



4 



How would you rate activity 5 h 3 2 1 

instructions in helping to H -j j- 



bring the Life Skills experi- ver^ high very low 

ences to a close? y 
CommeiKfs : 
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CLARITY OF THE TEXT (continued) 



How feasible are the activities 
In the Guide for yod to conduct 
iri your classroom (e.g., the 
need for special props or 
groupings woQld decrease 
feasibility)? 
Comments : 



H h 

ve ry 
feasible 



-i f— 

ver% . 
infeasible 



How relevant are the activi- 
ties in the Guide* for the needs 
and interests of your students? 
Comments.: 



+ 



very 
-relevant 



2 



ve^-y 
irrelevant 



How appropriate are the ac- 
tivities to the developmental 
level of your students (e.g.. 
too advanced reading level ^ 
for your students decreases 
your rating of appropriate- 
ness)? 
Comments: 



H i 

very 
app ropr fate 



1 



H- 

very 
inappropriate 



How clear is the relationship 
between the four Life Skills 
strategies (Listening for 
Feeling, Behavior Feedback, 
Values Classification, Role' 
Playing) and the activities 
presented in the Guide? 
Comments : 



4- 



very clear 



+ 



4- 



very unclear 
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V, ACTIVITIES 



• Howjr/ould you rank the importance of e'ach of the Life Skills 
.strategies listed below insofar as their use fn the classroom 
is concerned? (rank 1-4, vd±h h being rr.ost important) 

Lfstening for Seeling 

• Behavior Feedback 



Values Clarification 
Role Playing 



2. How would v.u rate your frequency of use of each of the Life 
Skills st.ategies? . 



Never Seldom Occassional ly Frequently -Conti 
2 3 i|. 



Listening for 
Feel ing 

Behavior Feedback 

Values Clarifica-' 
t ion 

Role Playing 



t 



5. 



* 



EMC 
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Figure 1 



ACTIVITIES - EVALUATION PANEL 



Directions: On .the form below, list telt*to fifteen activities which you 
have tried from the Guide. „ Please leaf through the Guide 
to refresh your memory. Aft©/ you have listed the activi- 
ties, turn to the next page for further instructions. ' 



Level of Guide 



ACTIVITY* (Title and 'paqe) 


F 

D-W-M- 


M/N/l 


L-D. , 




v 


- 1 J 


c 
o 


" - — 0^ 










< 






•* 












*. 










4 










* 












A 




• < 




— « 










r 


or". 




t 




i 








\ 




\ 












\ <■ 


1 
























-> 
























6> 






















u — 
















■ » 








* . ♦ 




































> * 




























• 
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ACTIVITIES - EVALUATION PANEL 



f 



Directions: The following steps are to be followed for' each activity 
listed. Complete one column for all listed activities 
before beginning the second column. * 

y 

STEP ONE - In the^irst column, marked F: ' _ 

Write the letter D if you use this activity daily. 
Write the letter W if you use this activity weekly. 
Writef the letter M i J you use th i s' act i vi ty monthly. 
Write the letter I ]4 you have used'this activity less 
frequently 

TEP TWO - In the second column, marked M/N/ I : 

Write the letter M *K you taught this activity as a 
part of a special, separate mini-course. You may have 
begun the day, or filled in an extra 30 minutes with it, 
or you do an activity at the end of lunch every day, etc. 



Write the letter N if you taught this activity at a 
natural or teachable momen£^ This most often would occur 
when something happens irtgfcss that is related to one of 
. the topics/activities in^nT^uide. « 

V 

Write the letter I if you taught this activity as an in- 
tegrated part of some subject. This would require struc- 
turing the activity so that the context of a lesson (e.g., 
history) and the process of the activity were integrated 
(e.g., how would you have felt as a member of Nixon's 
cabi net) . 

to. 

STEP THREE - In the third column, marked L-D: 

A 

Write the letter L after t\ose activities that your stu- ^ 
dents particularly liked. \ v 

Write theletter D after those activities that your stu- 
dents particularly disliked. • 
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VI. HELPFUL NOTES 



Directions: 



■v 



4. 



5. 



6. 



UJphJ ? ,0 E.°J ^"t'onnaire asks you to indicate the 
extent to wh lc h you use the suggestions provided at the 

i2'. n ! ! GuideS ' Cfrcle Ae number - Indicating the 

amount or /time you spend. 



1 - Never/ 2 * Seldom, 3 * Occassional fy k 
5 c Always- ' 



Frequently, 



!. 



2. 



3. 



When you use the/ activities to what 
extent to you spend at least one- 
half hour on an activity? 

When you use the activi^s to what 
extent do. you allow tim^or dis- 
cussion as part of the activity? 

When you use the activities to what 
extent do you discuss the process 
and purposes of the activity before 
beginning the activity? 

When you use the activities to what 
extent do ytiu post a list of simple 
rules v/hich the class agrees to 
fol low? ^ 

When you use the activities to what 
extent do you participate .in the 
activities? 

When you use the activities to what 
extent do you explain to students 
that they do not have to share 
their opinion or feelings if they * 
do not want to? 



3' 



7. When you use the Activities to what 
extent do you raise questions to 
^encourage the students to reflect 
on v/hat has occurred during the 
activity and what they have learned? 
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HELPFUL NOTES (continued) 

8. When you use the activities to v/hat 1 2 3 k 5 
extent do you conclude each activity 

with a summary activity (e.g., com- / < 

plete "I learned 11 statements . . .)? 

9. In general, to what extent would you 12 3^5 
estimate that you use the, Life Skills 

Activities in some way In your class- 
room? 
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VII. ANECDOTES 



Directions: In tftls section of the questionnaire we_are interested in 

learning about specific incidents .that you have experienced 
^ S 3v be ^ n P rov ' ded afte «* each question for you to des- 
^ ct*ib e a specific situation/ An swej: only -those items appli- 
cable to your experience, dnd include both positive and 
negative experiences. I 

I. Would you describe one or more occasions when you used an activity > 
as a separate piece or series of-pieqe^ (e.g., mi ni -course) .. A 



3. 



* 4 

2. Would you describe one or more occasions when an activity was ased 
-^because of a natural event (teach^bile moment) in your classroom. 



f 




ANECDOTES (continued) 

3. Jfould you describe ene or more occasions when an activity was usee! ' 
» as part of a regular lesson plan in your content area (e.g., science) 



.... • * * 

h. Can you de^ribe some effects that one or more specif ic activities 
had on your class, (e.g., you enjoy teaching more, you have fewer 
discipline problems, the students work better together, etc.) 
Attempt to. connect -the effect you have observed with ah activity or 
series of activities. 
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ANECDOTES (continued) 



5. If you were to recommend any changes In the Life Skills Activities 
Guides, what would they be? 



\ 



9 

ERIC 
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SUMMARY OF CONSUMER EVALUATION PANEL FINDINGS 




SUMMARY OF. CONSUMER EVALUATION PANEL FINDINGS 



Georgia Life Skills for Mental. Health Evaluation Project 
'Research' for Better Schools,* Inc. 



On Sat., October*28, 1978, we he4d-an™£va44iatiorv^anel Revfewn'~n~Macon,Ga, 
We invited 14 teachers who had been trained in Life Skills last year. We 
asked them for an extensive review of the Leader's Guides. Here are some 
specific suggestions they had. 

1. They aslced that the Guides be handed out at the beginning of the 
.training Sessions. They felt that tfris was particularly impor- 
tant when classroom time occurs -between training sessions. # 

■ 2. They wanted' to use more activities from the Guides during the 
training sessions so they can see them in action. This also 
gives the teachers a chancg to try'the activities either during 
the training sessions or in intervening classroom tiirfe. * ^ 

They felt the need for a Keyword Index. This has nothing to do 
with the 'training sessions, of course. It is mentioned so that 
you can^£ell them that the Life Skills staff is, aware of the 
9 problem. 

4. They wanted more activities. Perhaps you could stress that' the 
Guides are just a beginning— encourage the teachers to make lip 
and try their own activi ties—or to consult the .extra readings . 
in the Appendix for other activities. A Newsletter has been 
proposed— you migh£ give it a "plug 11 during the training sessions 

5. Some tea'chers felt that the 5-8 level Guide had too great a 
span. Some of the activities (e.g., writing an essay) were too 
hard for K and lsf graders. Primary grade teachers might be 
alerted to this-ftrobfem and ur ged to contr i but e thei r-ewn-aet4-— 
vifresHo the Newsletter. 

C — - a ( 
* / 

6. The teachers wanted to go over the Guides during the training 
sessions> The Helpful Hints part might be good for this—it 
has ideas for opening and closing Life Skills activities and 
general guidelines for use in the classroom. 

7. The teachers wanted some examples of "probing" questions they 
could use at the end of sessions— and they wanted to see the 
questions in action so they could "model" the trainers' behavior. 

8. ^e teachers wanted the trainers to bring any mateYial* they had 

to .the sessions so they could look them over— i.e'., they wanted 
* the trainers to share resources. 

9. The teachers felt they needed help in anticipating problems they 
would encounter and suggestions for dealing with the problems. 
Sample problems were: young children copying each other— e.g. , v 

r they all "feel sad"; exercises turning into put-downs; children 
giggling^etc. when other children sharetheir feelings; occasions 
, when behavior feedback doesn^ work. 

Our evaluation is* attempting to gain information for feedback to the life 
Skills staff. Are there any areas of information you are interested in? 
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LIFE SKILLS FOR MENTAL HEALTH TRAINING 
WORKSHOP-REGISTRATION-FORM 



ERIC 
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Name: Ms 



TisT 



LIFE SKILLS FpR MENTAL HEALTH 

Training Workshop — Registration Form 



L 



First 



Job TiJIe (occupation 
Business Address _ 



Middle 



Phona. 



Home Address 



Phone 



Dat* of present Life Skills Workshop . 



.Location. 



. Why did you decide to participate in the Life Skills for Mental Health Training? 



Organization sponsoring your participation 

r ' J *~ " : 

With what groups of young people (e.g., Scouts, Sunday School classes) will you be using 
Jhe Life Skills Activ4v-6uides3 ~ 7 __ . 1 



What age levels? 



Have you had previous training in any of the following areas (check all that apply)-? 

W 

□ Values Clarification □ Communication Skills * 

□ Assertiveness training \ 

□ Other similar programs (pieas^ specify) 

Years experience in present field 

JEducation 

Age: , 



D Ro'e Playing 
□ P.E.T./T.E.T. 



.Major. 



■under 25 



. 25-34 



35-45 



over 45 



- J? 
£ 8 



9 

EMC 



School System J_ 



School 



Subject/Speciality Area 



. Grade Level 
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LIFE SKILLS FOR MENTAL HEALTH FOLLOW-UP 
SURVEY; ON TEACHER TRAINING. .WORKSHOP 



'J 



A-40 



237 



LIFE SKILLS FOR MENTAL HEALTH" 
FOLLOW-UP SURVEY ON TEACHER TRAINING WORKSHOP 

/ 

Name (Optional) Date 



School System 



Grade Level 



Subject Specialty 
Area 



No. of Years 

Teach i ng Exper i ence 



/ 



This quest.onna.re Is a follow-up on the Life ^k! lis Teacher Training 
Workshop that you attended. |f S purpose is to collect feedback for im- 

f uture wor Kshops. Please answer each question as honestly and 
completely as possible. When you have completed the questionnaire, please 
place it in the enclosed .postage-pa id envelope and return to- RBS. Thank 
y ou # 1 
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Part I: Use of Life Skills-Activities 



1. Which Life Skills Activity 

A. Ages 5-8 

B. Ages 9-11 
~ C. Ages 12^14 

' D. Ages 15-18 




o you use? (Circle your answer.) 



2. On the average, how often do you use Life Skills activities in your 
classroom? (Circle Y°j^ answer.) 

A. * Once a day or more 

B. Several times a week " 

C. About once a week 

D. Several times a month 

E. Once a month or less 



3. Which of the Life Skills activities have you found the most helpful? 
; P lease name or- des cr i be t-hese-ac-fr t v4 1 i es . — i l i s-t page -numbers- when — - 
possible.) 



4. Have you tried any variations of the Life Skills activities or created 
any of your own similar activities? Please describe. 




"J 



5. Life Skills. activities can^bt^employed in a number of ways. Estimate 
what percent of all the kite Skills activities that you have used fit 

_ JLato_.each-of the-Ji)LU.owxng^categoc.ies: 



% 
% 



Integrated wi th classroom lessons 
*Used as separate activities 
Introduced at teachable moments 
Other 



100* 



>. Four strategies were introduced in the-workshop you attended. Please 
( indicate how often you have used each of these strategies - before * 
the workshop and now, after' the workshop. * 



For each of the strategies* circle the letter that 
often you have used this strategy. 

• v 

A,- Once a day or more 
* 8 r. Several times a week 
C - About once a week 

r D - Several t i-mes a-mgnt^ 

E - Once a monttwor less 



ndicates hov?\^ 



/* Li steal rf^af Feeding 
/ Behavior Feedback V 



Va I aes ^1 a? Pf i ca t i on - 



Before Workshop 



A 



B' 
B 

7&y 



6 
.C 

f 



D 
D 

-D- 



A,. B 



C ; D 



E 
E 
E 
E 



After Workshop 
A B C D E 
A B C D I 

a - - r — t — tj — r 

A B C D E 



How do the- J_i fe* Ski 1 ls/actiyi ties compare to s'imi lar "mater ial s you have 
used in your class room'^thaj^deaLwrth feelings, values or emotions? 
Circle your answer. . . - 1 



A. 
B. 
C. 
D. 



E. 

Comments : 



The Life Skills activities are rpore effective. 
The Life Skills activities are just as effective. 
The Life Skills activities are 1 ess- effect i v6. 
The Life Skills act i vi t i es address different topics and 
cannot be compare*? to other materials. 
1 have not used othei* affective materials. 



r 



-^-43 

' 240 



Part II: Student Response to Life SkMjs Activities 
8, How has (have) your class(es) responded to the Life Skills activities 



A. Very pos i ti ve ly 

B. Positively 

C. Neutral 

D. Negatively ^> 

E ( . Very negatively* 



Comments : 



9. Since youVbegan using -he Life Skills activities and strategies, have 
you noted ^any chsngos in your students in the following areas? 

Fpr each area, rircle the letter that best indicates the degree and 
direction of change you have observed. 

A. Very positive change . * 

B. Positive change 

C. No change / 

D. Negative change / 

E. Very negative change / 



Behavior 

Students 1 abiR-ty to express their 
feelings. 

Students' ability to accept their 
feel i ngs. 

Students 1 ability to accept the 
feel Ings of others. \ . 

4 

i Students 1 ability to accept the ^ 
J values of others. 

Students 1 self-confidence and self- 
awareness. 

Students 1 ability to get along with 
one aether. 

Students©&bi 1 i ty to cooperate and 
relate, t^ you '(the teacher). 

r Student^J ability to controls their 
behavior and sq\ye problems before 
they become major disruptions. 




CD \ 


C 


D E 


/ B 


C, 


D E 


. B 




D E 


CO 


C 


D E 


B 


c 


D E 


CD 


c 


D E 


B 


c 


D i E 


B 


c 


D E 



10. Have you seen any noticeable changes in individual students since you 
began using the Life Skills activities? Please describe. 

) 



Part III; Usefulness of the -Work^ho^ 

r 

m 11. How much of the material presented in the workshop was new to you? 

A. All 

B. Most 

C. Some 
0. None ' 

12. How much of the material presented in the workshop has been helpful 
to you? c 

\) A. All ' 

B. Most 

C. Some 

D. Noge ,.- * , 

13. Did the workshop meet your Ay pe r tat i ons ? ■ 



A. "It was exactly what I expected. 

B. It^was close to what I expected. 

C. It was different from what I expected, ?r 

D. It was ve^ry different from what I expected, 

Comments : 



( 



i 
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H. What is the one aspect of the workshop that has been most useful to 
you7 ■ 



15. What is the on£ aspect that was least useful to you? 



16/ How highly would you rate the success of the workshop in helping you 
to integrate the L fe Skills activities and strategies with you? " 
* lesson^pians and classroom content? 



A. Very high success 

B# High success v 

C # Medium success 

D, N Low success 

E, Very low success 



17- What additional topics do you think should be covered in future Life 
Skills Teacher Training Workshops? Should any topics be eliminated? 



,8 ' unrJ° Ur atten ? an " at the L!fe Skr 1 Is Teacher Training Workshop vol- 
untary or required? H 

A, Voluntary _ 

B, Requi red 

* » r 

19. Did you receive any type of credit for the Life Skills Teacher Train- 
ing workshop? (Circle all that apply.) • , 

A. Certification renewal credit. 

B. Local school system staff development credit. 

C. Coursework credit through a college or univeTsity. ' 
Oi. No credit, options were available. 



5 
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20.1 In what format was your Life' Ski 1 Is workshop presented? 



(jlne day workshop s v 
Jmjrfay_w&£kshop*_ _ _ 
^ne cfay workshop with later follow-ups 
two day workshop with later follow-ups 
Several Saturday sessions 
Several evening sessions 
Dther t 



20.2 Would you hiave preferred a different format? 
* i 



No. -I was satisfied with the format, 
Yes. I would have preferred: 



21. 



One day workshop 

Two day workshop^ 

One day workshop with later 
day workshop ^ith later 
_ Several Saturday sessions 
Several evening sessions 

Other - 



fol low-ups 
fol low-upj 



The planned* objectives of the teacher training workshop are listed 
below. c Baied on your experienced t'h \he Life Sk.ills activities in 
your, classroom, please circle the number which indicates how we1 l you 
feel each object ive was attain^ 9 

\ m ~ * Very * Very Un- 

Objectiveg : ■ m Successful 'Uncertain successful 



To createjan awareness of the 
importance of affective educa- 
tion. 

* I h 

" To .Increase understanding of 
>the relationship between affec- 
tive and Icogni t)yp. learni ng. 

To create an understanding of 
the rationale for promoting 
posit ivei affective ar)d cogni-. 
tfve grdwth as a prevention 
strategy! in mental health. 

To introduce and "Remonstrate 
selected classroom\act ivi t ies 
'In, the /Li fe Ski l Is Program. — 



A " 



'E 



7 
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Object i ves ; 

To facilitate teachers 1 per- 
sonal knowledge and skill in 

th.e four Life Skill Strategies, 
* 

To develop and/or increase 
teachers' confidence in their 
ability to'conduct Life Skills 
acti vi ties. 

To provide resources for 
additional training, consul- 
tation and materials. 



Very . 
Successful 



Uncertai n 



B . C 



B* C 



Very Un- 
successful 



22. As a group, how would you rate the ability of the workshop trainers? 
A, Very W-gh 



C. Medium 

D. , Low 

E. Very low 



Comments: 



23. * Additional comments on any aspect of the Life Ski t lls workshop or 
materials would be appreciated. 
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SPRING 19/9 RESULTS OF FOLLOW-UP SURVEY 
ON TEACHER TRAINING WORKSHOP 



A-49 



9 
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4 



LIFE SKILLS' FOR MENTAL HEALTH 
FOLLOW-UP SURVEY ON TEACHER TRAINING WORKSHOP 



Namfc (Optional) 

* 

School C/stem 



Date Spring, 1979 



23, Schools 



Grade Level 



Subject Specialty 
Area 



No. of Years 
Teaching Experience 



Mean ■ 10.5 
Range = 2 to 33 



This questionnaire is a follow-up on the Life Ski 1 Is. Teacher Training 
Workshop that you attended. , Its purpose is to col lec^ feedback for im- 
proving future workshops. Please answer each question as honestly and 
completely as possible. When you have completed the questionnaire, please 
place it in the enclosed postage-paid envelope and return to RBS. Thank 
you. 



Subject 

> 

Elementary Education 

Early Childhood 

Engl ish 

PE and'Health 

Social Studies 

Special Education" 

Math 

Language Arts and Reading 
Other 

'No Response 
Total 



10 
3 

3 
5 

5 
5 

13 
8 

So- 



Grade Level 




Primary 


13 


Middle School 


17 


Junior High 


15 


Senior High 




Other 


8 


No Response 


3 


Total , 


. So 
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Part It, U se of Life Skills Activities 

1. Which Life'Skills Activity Guide do you use? (Circje your answer.) 

A, Ages 5-8 * 
6. Ages 9-H • * 

C. Ages I2-1* ' , K 

D. Ages\^5-18 » T 

2. On the average"' how" of ten'do you use Life Skills activities in your 
classroom? (Circle your answer.) 

A. "Once, a day or more 

B, Several times a week 



C. About once a week / ' J 

D. Several times a month 

E. Once a month or less T -J ^ , 



3 Which of the Life Skills activities have you found the most helpful? 
Please name or describe these activities. (U.st page numbers when 
possible.) 



\. Have you tried any variations of the Life Skills activities or created 
.any of your own similar activities? Please describe; 



V 



Mean Percent 



6. 



.ffe Skills activities can be employed in a' number of. ways. Estimate 
Jhat percent of all the Life Ski lis activities that you have used fit 
into each of the following categories: 



21 



% 

% 
% 



Integrated vtlth classroom lessons 
Used as separate activities 
Introduced at teachable foments 
Other: % 



100% 



V 



\ 



Fouri strategies were introduced in the workshop you attended. Please 
indicate how often you have used each of *hese strategies - before 



w , ^y., jrwu nave usea eacn or ' 

\ - t i he wbrkshop and now, after the workshop. 



•'For each of the strategies, circle the 
— of-ten-y0u-have-used-t4vr S — strategy; 



See attached 
summaries 



letter that best indicates how 



A, 

B 

C 

D 

E 



- 'Once a day or more 

- Several times a week 

- About once a week 

- Several times' a month 
-'Once a month or less 1 



" Percent 



Listening for FeeJ i'ng 
Behavior Feedback 
Role Playing 
Value.s Clarification 



Before Workshop 
A B C D E 
A ' 6 C D E 
■A B C D E 
A B C D E 



After Workshop 
A .B C/'. 0 E 
A B C D E 
A B C 0 E 
A B C D ' E 



5 1 

SO 

05" 

07 
07 



7.. How_do the Life Skills activities compare to similar materials you have 
used ,n your classroom that deal with feelings, values or emotions? 
Circle your answer. .. 



A. 
B. 

C/ 
0. 

E. 



The Life Skills activities are more effective. 
The Life Skills activities are just as effective. 
The Life Skills activities are less effective. 
-The Life Skills activities address different topics and 
cannot be compared to other materials. 
1 have not used ojther affective materials. 



Comments ; 
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6. .FREQUENCY OF USE OF LIFE SKILLS STRATEGIES 



Listening for Feeling 

A, Once f day or more 

8. Several times a week 

C. Aboutf once axeek 

D. Several times a month 

E. Once a month or Jess* 



Percent 



Before 


After 


26 


48 


29 . 


34 


16 


05 


15 


07 


15 


05 



Behavior Feedback 



At O nce a day o r mor e 

B. Several times a week 

C. About once a week 

0. Several times a month 

E. Once a month or less 



07 
26' 
28 

13 
, 26 



31 
46 

07 
11 
06 



Role Playing 

A. Once a day or more 

Several times a week 
C'.' About once a week 

D. Several times a' month 

E. Once a month or less 



06 
02 

13 
24 

57 



09 
16 
20 
21 
34 



Value Clarification ' 

A. Once a .day or more 

B. Several times a week 

C. About' once a week 

D. Several times a month 

E. Once a m onth or less 



06 
11 
20 
22 
41 



17 
22 
22 
21 
19 
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Percent 



23' 

56 

14 

Ok 

03 



Part II: Student Response to Life Skills Activities 
8. How has (have) your cl^ss (es) "responded to the Life Skills activities? 



5- A. Very positively 

*- B. Positively 

3- C. Neutral 

2- D. • Negatively 

1" £. Very negatively 

Comments: 



Mean Rating 
3.91 



Mean Response 



Since you began iusing the Life Skills activities, and strategies, have 
you noted any chsngsS in your students in the following areas? 

For each area, circle the letter that best indicates the degree and 
direction of change you have observed. 

A. Very positive change (5) 

B. Positive change - (k) ' * - " 

C. No change (3) 

D. Negative change (2) 

E. Very negative change ** 





Behavior 


3.87 


Students' ability to express their" 
feel ings. 


3.75 ? 


Students' ability to accept their 
fee Tings. 


3. 77 


Students' ability to accept the • 

_____ fee Uags__of_ others* _ . __ 


3.57 


Students' ability to accept the 
values of others; 


3.79 

• 


Students' self-confidence and self- 
awareness. 


3.77 


Students' ability to get along with 
one another. 


3.87 


Students' ability to cooperate and 
relate to you (the teacher). 


3.70 


Students' ability to control their 
behavior and solve problems before 
they become major disruptions. 



A 
A 
A 
A 

A 

A 

A 

A 



Degree of Change 
B C D 



B 

n 

B 
B 
B 
B 
B 



C 
C 
C 

C 

C 

C 

C 



D 

D 

D 

D 

D 

D 

D 



E 
E 
E 

I. 

E 

E 

E 

E 



1 
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10/ Have you seen 'any noticeable changes in Individual students stance you 
began using the Life Skills activities? Please describe. 



Part HI: Usefulness of the Workshop 



Percent ]l # 

05 
28 
58 
08 



How much of the materia! presented in the workshop was new to you? 

A. AIT 

B'. 'Most 

G. S,ome # ' " 

D. None 



Percent '2. 



How much of the material presented in the workshop has been helpful 
to you? 



22 
30 
43 
05 



A. All 

B. Most 

C. Some 
0. None 



Percent 13» Di-d, the workshop meet your expectations? 



11 
55 
25 
09 



A. It was exactly what I expected,, 

B. It -was close to what I expected. 

C. It wqs different from what I expected, 

0. It was very different from what I expected. 



Comments ; 
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20.1 



r ln what format was your Life SkJ lis, workshop presented? 



Percent 



09 



IT 



19 



19 



12 

IT 



One day workshop ^ 
Two day workshop 

One day workshop with later follow-ups 
Two day workshop with later follow-ups 
Several Saturday sessions 
Several evening sessions 
Other f' 



20.2 Would yojj have preferred a different format? 



Percent 



75 



25 



No. 
*es. 



I 



Percent 



was satisfied with the format. 
I would have preferred: 

One day workshop 
Two day workshop 

One day workshop with later fdllow-ups 
Two day workshop with later' fol low-ups 

2 Several evening sessions 
43 Other 



07 
21 
07 
21 



21. 



Mean 



Rating 



4.16 



3.95 



-3.96 



4.06 



The planned objectives of the teacher training workshop are listed 
below. Based on your experience with the Life Skills activities in 
your classroom, please cirche the number which indicates how wfcl I you 
feel each objective was attained. * 

L Very 
Objectives : Successful 



1 



Uncertain 



To create an awareness of the 
importance of affect ive gedu ca- 
tion. pT 

To increase understanding of 
the relationship between affec- 
tive and cognitive learning. 

To create an understanding of 
t4*e-ra t-f ona+e fp r-promot-mg- 



Very Un- 
successful 



positive affective "and cogni- 
tive growth as a prevention 
strategy in mental health. 

To introduce and demonstrate 
relected classroom activities 
In the Life Skills Program. 



B 



C > 



B 
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3-. 96 



3.82 



3.79 



Objectives : 

To facilitate teachers 1 per- 
sonal knowledge and skill In 
the four Life Skill Strategies. 

To develop and/or increase 
teachers' confidence in their 
ability to conduct Life Skills 
activities. 

To provide resources for 
addi tional training^ consul- 
tation and materials. 



Very 

Successful Uncertain 



B 



Very Un- 
successful 



C D 



Percent ^ 22. As a group, how would you rate the ability of the workshop trainers? 



19 
<*9 



•09 
07 



5- A. * Very high 

B. High 
*3~ C. Med i unT 
2- D. Low^ . 
E. Very low 



Mean Rating 



Comments ; 



23* Additional comments on any aspect of the 
materials would be appreciated. 



Life Skills workshop or 
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\h. What is the one aspect of th<workshop that has w been most useful to 
you? ' * 



\ 



15* What is the one aspect that was least useful to you? 



Percent 16, 



How highly would you rate the success of the workshop in helping you 
~re^-nTeg~rate~tfrg^^ act? v i t i e a n d~ s t^a teg t es- w i th- your—- 

lesson plans and classroom content? 



05 
32 
32 
20 
11 



5- A t Very high success 

4*" B, High success 

3.— C, Medium success 

lr D # Low success 

l<-» E, Very low success 



Mean Rati fig 



17. What additional topics do you think should be covered in future Life 
Skills Teacher Trailing Workshops? Should a^y topics be eliminated? 



Percent 18, Was your attendance at the Life Skills Teacher Training Workshop vol- 
untary or required? ^ — * 



48 

52 



A. Voluntary 

B, Required 



Percent 
Ci rcled 

35 
46 
22 
43 



19. Did you receive any type of credit for the Life Skills Teacher Train- 
ing workshop,™ (Ci rcle all that apply.) 

A. ' Certification renewal credit, 
B # Local school system sta/f developmerft credit, 

C, Coursework credit throi/gh a college or university, 

D. No credit options were available. 



A-58 



APPENDIX B 1 
STUDENT OUTCOME MEASURES 



MYSELF-Early Elementary \ 

MYSELF-Upper Elementary, Intermediate, High School 
* * v. 

MY CLASS-Early Elementary 
SCHOOL LIFE-Upper Elementary, Intermediate, High School 



ABOUT YOUR CLASS-Early Elementary 

ABOUT YOUR CLASS-Upper Elementary, Intermediate, High School 



ATTITUDE TOWARD SCHOOL-U P per_EIementarv_ 
ATTITUDE TOWARD SCHOOL-Intermediate 
ATTITUDE TOWARD SCHOOL-High School 



MY OPINION-Upper Elementary 

MY, OPINION ON DRUGS AND ALCOHOL-Intermediate, High School 



t CLASSROOM OBSERVATION FORM-A11 levels 
.DISRUPTIVE BEHAVIOR SCALE-A11 levels ' 
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Mfy Name: 

(Circle one in each row) . 
I am in grade: 1 2 
I am: a boy* a girl 
I am: Black * White 




Early Elemenfaty 



Asian American American Indian Hfspanic 



Myself 

Directions: Trie questions below are to find out what you like. Read each question 
carefully. Answer each question by^ircling either Yes or No. 



1 . Are you a ha^py person? 
*2. Are other children often mean to you? 
*3/ Do you usually let other children have their way? 
*4. Do you get in trouble at school? 

> « 

*5. Would you like to stay home instead of going to school? 
*6. Do you often feel unhappy in school? 
<7. Do your classmates think you have good ideas? 

8. Doyou have enough friends? ~ ' , 

9. Do you like being you? * 

10. Are you easy to' get along-with? 

11. Does your family^hink you are important? 
*12. Do you cry easily? 

*13. Do you often get in trouble at home? x 

14. Can you wait your turn easily? 
*15. Do you wish you were a different child? 
*16. Do you often break your promises? 
*1 7. Do you sometimes want to run away from home? 

18. Are you good in your s'choolwork? 

^tem polarity reversed for scale score computation. 



Circle j 


C* J 1 o V V 1 


Yes 


No 


Yes 


- 

No 


Yes 


? No 


Yes 


No 


Yes 


• No 


Yes 


No 


Yes"- 


No" 


Yes 


No 


Yes 


No 


Yes 


No 


Yes 


-No 


Yes 


No. 


Yes 


No 


Yes 


No 


Yes 


*No * 


Yes 


No 


Yes . 


No 


Yes 


^Jo 


Yes 


No 
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(Circle ono in oacfj category below) 
.'Ciriidn l> j>l 1 a f) . 10 11 
Ethnic Group: # / Black White . Asian American 
Sox: Male /Female 



Date „ 



American fndian Hispanic 



Myself 




Directs: , It is'impor tant to know how you feel abut the statments thai follow. For each stalemdnf circle 
the oofe number which shows how much you agree or disagree with the sbatement. Remember, circle 6nlv 
, one number for each statement. x ' c ✓ . 



1- It is easy for me to get along with others: 

2. "My parents ike to know what I think about 
things/ * 



*3. 
4. 

*5, 



I feel I'm not as nice looking as most people. 

If I work at something long enough, I will 
succeed. 

There are a lot of times when I'd like to leave 
home. ' *. 

* 6., I often feel ashamed of myself. 

* 7. Things are all mixed up in my life. 

* 8. I often wish Kwere someone* else. 
I have fun with my parents. 
I am often unhappy. " 
I am a lot fun to be with, 



1 9. 
*10. 



11. 
*12. 
'13. 
*I4. 

*15.' 

*17. 



It's pretty tough to be me. 
I'm easy to get along with. 
Someone often has to tell mc what to do. ' 
-It is fiaid for me to make friends. J 
The kids in my class make me feef*-important. 

4 t 

My parents push me too much. 



0 
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s » r on9ly ' ■". ' • 'Strongly 

Agtee Agree Not Sure Di'sagiee JDisagrop 



5 
5 



5 
5 



5 
5 
5 
5 
5 

-5- 



5 
5 
5 

5 



4 
4 



v 4 
4 



4 
4 
4 
4 

— 4- 



4 
4 
4 
4 
4 
4 



3 
3 



3 
3 



2 

I 

2 

2 
2* 



'1 



1. 




3 
3 

3». 

3 

3 

3 

3 

3 



2 
2 
2 
2 

—2 



* .1. 
1 

. 1 
"T 
1 
1 
1 
1 

1 
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' 2 
2 
2 
>2 
"2 
2 1 

(Go on tbythe otl*c Sir » ; * 



18. I like being the way I am. 

19. I like to be called on in class. 

20. Km pretty sure of myself 

0 

*21 . m My parents expect too much of me. 
* *22. I spend a Jot of time daydreaming. 

23. My parents: understand me-pretty well 

24. The kids in my class make me feel that I am 
good at doing things. 

' 25. I can be trusted, 

» 

*26. ' I get upset easily at home. 
27. Myjamily usually considers my feelings. 



Strongly 
Agree 

5/- 
5 

5 
'5 

5 
• 5 

5 

5 * 
5 



Strongly 

Agroo Not Sure Disagree Disagree 



*Item polarity reversed for scale score computation. 



4 
4 
4 
4 
4 
4 
4 

« 

4 
, 4 



3 
3 
3 
3 
3 
3 
3 

3 
3 
3 



2 
2 
2 
2 
2 
2 

2 
2 
2 
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My Name. . 

(Ci/cle one in oach row) 
I am in grade: .1 2 
I am: a boy a girl 

I am: Black V\il 



Date: 



Ihite Asian American * American Indian Hispanic 



y .. My Class 

Directions: The sentences below are to find out what your class is like. Read each 
serrtence carefully. .. ■ 

If you agree with the sentence circle Yes. 

If you don't agree with, the sentence circle No. 



Example 

My class is noisy. 



Circle your answer 



Yes 


No 


Yes 


•No 


Yes , 


y' No 


Yes 


No 


Yes 


No . 


Yes 


No 


Yes' 


• No 


Yes 


.No 


Yes 


No. 


Yes 


'No 


Yes 


No 


Yes 


No 


Yes 


No 


Yes 


No 


Yes 


No 


Yes 


No 



Many^children in my class like to cause trouble. 
*2. Yeroafraid toask my teacher questions. 

3. Most Children think our class is fun. 

4. My teacher likes all the children in. my class. 

5. Most children like our class. 

6. I like being in this class. 

• 7. My teacher is interested in things I, do at 'home. 

8. In my class I like to work with others. 

9. I can talk to my teacher about my problems. 
JO. All the children in my class are good friends. 

Some children in my class are not happy. 
12. My teacher understands how I feel. 
*13. Children in my class are always fighting. 
4 *14. Some-children don't like our class. 
,*15. My teacher likes some children better than others. 
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(Go on lo the of hot srh.) 



Circle your answer 



*16. kome children don't like other childrerwn {he class. 


Yes 


No 


17. Everybody in-my class is my friend. 

18. My teacher listens to me. 


Yes 


. No • 


Yes 


• No 


*19. My teacher doesn't understand me. 


Yes 


No 


20. My teacher likes to help all the children in my class. 


Yes 


No . 


21. All the^children in my class like each other. 


Yes 


No 


22. My teacher really cares-about me. 


Yes 


No ' 


*23. .My teacher yells too much. ' • 


Yes' 


No 


24. All of the children in my class know each other well. 


Yes 


No 


25. The children in my class understand me. 


Yes 


No • 


26. My teacher helps me talk about how I feel. 


Yes 


No 


* 

27. My class is fun. 


Yes 


No 



*Item polarity reversed for scale score computation. 
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/ 
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Uppe> Ficmcntary 



'Ni'Miir _* .... 

(Cuch: om* in each tuUogor^) 
Oia<l»» h 6 7 8 9 
Elhmc Group. Bldck White 
Sex: Male Female 



Date:. 



10 11 12 
Asian American 



American Indian Hispanic 



3 School Life 

i 

Directions: How students feel about what happens in their classroom is important. For each of tne state- 
ments that follow, circle the one number that best tells how well thestatement describes the classroom you 
are in right now. : 



1. 

3. 
4. 

*5. 
6. 



*8. 

9. 
10. 
11. 

• 12. 
*13. 

14. 



IMPORTANT: Answer all questions only for th,e class you are in right now. 



Every student in the class is treated the same. 

My teacher ignores some of my feelings. 

My teacher understands me. 

Each student knows the other members of -the 
class by their first names. * 

Somfc groups of students always work together. 

My 'classmates try to understand-how I see 
things. 

All class members help in making class 
decisions. 

In this class I feel that when I talk nobody else 
really listens. 

/ 

.All of my classmates get along well together. 

All of-my classmates know each other very well. 

When we have class discussions I have a 
chance to say what is on my mind. 

I enjoy ^ping in this cbss. m* 

Students in this class do not know each other 
very well. 

I realty look forward to discussions we have in 
this class. 



Strongly 
Agree 

5 
5 
5 

5.. 
5 



5 
5 



5 
5 



V 
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Strongly 

Agree Not Sure .Disagree Disagree 



4 
4 
4 
4 

» 

4 
4 



3 
3 
3 
3 

3 
3 



2 
2 
2 
2 

2 
2 



4 
4 
4 

4 
4 



3 
3 



3 
3 



2 
2 
2 

2 
2 



26Z ' 



{Gb on to the othc: 



15. My teacher is friendly and warm towards me. 



k 16. 



18. 

19. 
20. 
21. 

22. 

23. 

24. 

25. - 

26. , 
21. 

i 

28. 



When we have discussions in class I just sit and 
say nothing 



1.7 . My teacher appreciates me. 



Each member of the class has an equal say in 
making decisions. 

My teacher tries to understand how I see things. 

This class help's me to listen to others better. 

Thrs class has helped me to get along with ' 
other people. 

Each student has the chance to get to know all 
other students in the class. 

My teacher is interested in knowing how thinqs 
seem to me. - . 

This class is pretty good at having discussions. 

Even wher/l can't say quite what I mean, my 
teacher still understands me. 

< » * 

Class members enjoy solving different kinds of 
problems. 

All of my classmates work' well together. 
I really.got to know my teacher in this class. 



Strongly 
Agroe 

5 
5 

• 

5 
5 

5 
5 
5 



Strongly 

Agieo Not Sure Disagree Di^igrVc 



5 
5 



5 



4 
4 

4 
4 

4 
4 
4 

4; 



4 
4 



3 

-3 

3 
3 

3 
3 

» 

3 



3 
3 



3 
3 



2 
2 

2 
2 

2 
2 
2 

2. 



2 
-2 



2 
2 
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My Name: 



Early Elementary 



Date: 



5* 



(drcle one in each row) 

I am in grade: 1 2345 
I am: a boy a girl 

. I am: Black White . Asian American 'American Indian Hispanic 

About Your Class i 
Directions: Look at the examples below. Show how well each of the words i-n the 
example describes your class by placing an (X) in the one square that shows how 
much the word is like your class. 





u A lot. like 


Kind of like 


Not at all fike 


Example 1: 


* my class 


fny cldss 


my class 


Noisy 


□ 


□ 


□ 


lExample 2: Try another one. 






Kind 


□ 


□ - 


□ 



Now, do the same for all the words that follow 

A lot like 
my class 



Kind of like Not at all like 
. ° my class , my class 



1. Friendly ts 

{ 


. □ 




D 


2. Hard-Working 

a 


□ 




□ 


*3. Gloomy 


□ 


□ 


; □ 


4. Care about each other 

• 




. □ . 


. □ 


i 

•5. Understanding 


□ 




□ 


*6. Sad 


■ □ 


□ 




7. Easy to be 'friends with 


□ 




■ . □ 


8. Fun 




□ 


■ □ 


*9. Fight a lot 








10, Pleasant 

o » 


□ 


- □ 


□ . 
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Upper Elementary 
Intermediate 
High Schoo 1 



Name- 



(Circle one in each category below) 
Grade: 5 *6 7 8 9 10 
Ethnic Group: Black White 
Sex: Male Female 



Date: 



11 12 
Asian American 



American Indian Hispanic, 



About Your Class 



Directions: For each word below, circle the one number that indicates how well you think this word 
describes youY classmates. — ' 0 0 



IMPORTANT: Answer all questions only for the class you are in rigfjt now. 



My classmates are: 



Strongly 







Agree 


Agree 


' Neutral, 


Disagree 


1. 


Friendly 


5 


4 


3 


2 


2. 


Hard-Working 


5 


4 


' 3 


2 


*3. 


Gloomy 


5 


^4 • 


3 


' '2 




Caring about one another 


5 


4 


3 


2 












5. 


Understanding 


5 


4 


3 


2 • 


6. 


Easy to be friends with 


5 


4 


3 


2 


*7. 


Unhappy 


5 


- 4 


3 


2 






k ■ 








8. 


Fun 

4 


5 


4 * . 


•3 


2 


9. 


Considerate 


5 


4 


3 ' 


« 2 


*10. 


Unpleasant 


5 


4 


3 - 


2 



Strongly 



*Item polarity reversed for scale score computation. 



Upper Element-try 



(Chclo o'if> m each category below) 

Grade 5 6 7 0 9 10 * 11 12 

» 

Ethnic Group. Black White Asiai. American 
Sex. Male Female 



American Indian Hispanic 



» • 
Attitudes Toward School ' 

Directions: Below arc 28 things that you might do in ot out of school. Circle the answer which best 
describes how you feel when you are doing the activity. Circle only one answer for each question. 



7 



HOW DO YOU FEEL: 



/ 



4> 



1. 


When you think about your schoolwork? 


4 


3 


, 2 


p 


/\Duui learningfborneining oy reaoing a oooKr 


4 


3 


2 


o 
o. 


vvnen you learn anxri rnenc in school f 


4 

* 


•3 


2 




un aays wnen you can t go to school? 


4 


3 


. • 2 


5. 


About having to remember so many things at school? 


> 

4 


3 


2 




When you play games that make yoju think? 


4 


3 


2 


7. 


• When you learn about science in school? 


• 4 


3 


2 


8. 


When you talk to yourprincipal? . 


. 4 


'3 . 


2* 


9- 

* 


About talking with a friend about the things^you have 
learhed in school? • 


4 


V 

3 


2 


10." 


When you write stories in school?' * , * v 


' 4 


3 


- 2 


11. 


When yQu learn to read in school? * < * 


•s 

4 • 




• 2 


. 12. 


When you think about how much your teacher carps 
about your class? ' < * 




3 


2 


13. 


When you have homework to do? 


4 ' 


3 


O 

c 


14. 


About learning new things at home about scfeaqe? * 




3. 


t 

,2 


15.- 


When you think* about haw tai.rly tho children are 
treated in your schoof? - . t 




' r 

3 




,16. 


When you learn new things in school? 


• A- 


3 


2' 


17. 


When you talk to your teacher?* ' 


4 


3 


2 


18. 


When you think about bow much the principal cares 
about the children? 


• 

.• - 4. 


3 " 


2 



J 



Adaptec! Jfioui lh€ 1974 Pennsylvania Student Questionnaire, Pennsylvania 'Department' of Education,, educational .J.u'.-y 
As$uisrr.&nt . . " 

a * . ♦ * 



19. About studying something with a friend? 

20. When you come back to school after a vacati6n? 

21 . When you are given a .book for a birthday p, esenl? 

22. About asking your teacher for help? f 

23. Whrn yotflearn social studies in school? 

24. Wnon you fhink about your classroom in school? 

25. When you practice your writing in school? 

26. When you study for a test? 

27. About reading a book by yourself? ' 

28. On days when you are in school? 

T 



*Item polarity reversed ftv scale, score computation. 




\ 



ERIC 



B-ll - 



26? 



Intermediate 



Namd 

(Ctrclo ono in onch cotoyory below) 
Grade- 0 " 0 . / 8 U. tu n 12 
Ethnic Group: Brack White Asian American 
Sex; Male Female 



Date: 



American Indian Hispanic 



/ 



Attitude Toward School 



each'statlnf ST ^ " ** ° f , ? toments - Circl ° the answer which best shows how you fool about 
each stdtment. Circle only one answer for each statement. ' 



Strongly disagree. 
s Disagree 
Uncertain 



*1. Most of my classes this year are boring. 
*2. I go to school only because I am made to go, 

3. I would like to join a group to learn.something new. 

4. I feel that I would like to return to school from time to time 

during my whole life. 

5. - I would like to Jearn a new game even if I Idse at it. 
*6. I don't like to learn new words. 



Strongly agree 

t 



Agree 



7. I^have a need to learn as a thirsty man needs water. 



8. I want to keep learning fo'r'the rest of my life. 

9. I try to learn things wherever I am. 
*10. Studying is a waste of time. V 

11. I try to re^member a new word. 
*12. Practice problems and drills are a waste of time: ' 

13. I hke learning how to do something in a new and different way. 

"14. I wish that I could learn everything there is to know. 

*15. I dbn't like games that make" m,e think. 

*16. It is a waste of time to'read a textbook if I won't be tested on it. 

17. f I like%chool. . 

*18.o Teachers are not interested in students. 

*19. I would like to quit school now or pp soon as I am 16. ^ 

*20. School is a waste oik time. 



M«?M from me ,974 fWy/wma Student bu^j.onnalre. 



1. PtnrtSylvnn.i Department o) 



5 
5 



5 
•5 
5 
5 

.5 
5 
5 
5 
5 
5 

•5 
5 



4 
4 
4 
4 

4 

4 

4 

4. 

4 

4 

4 

4 

4 

4 

4 

4 

4 " 
At 




3 
3 
3 
3 



3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
3 
.3 
3 
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2 
2. 
2 
2 

2 
2 
2 
2 



2. 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 



.(Gc^ on to llui r>thw .,<tfo." 



"I 



21. 

22. 
" 23. 
24. 

*' 25- 
• *26. 

*27. 
. 28. 

*29. 




.Strongly disagree 
Disagree 
Uncertain 



Agree 



30. 



Strongly agree 

Sdnob4&Jielp to make this^better country. • . 5 

t like my teachers. 5 

Going to school is a ^prmlege''. £ 5 

I like to get back to school after vacation. , 5 

Mriost of my subjects this year .are worthwhile. . 5 

SGhool is a dulUoface. 5 

Teabhcis don.'t know what they are talking about. 5 

It is vei y important to me to learn as much as I possibly can. 5 

Most homework my teachers give me is a waste of time. 5 

I like fo do things that challenge me and make, me learn. 5 



4 
4 
4 
4 
4 
4 
4 
.4 
4 
4 



3 
3 

,3 
3 
3 
3 
3 
3 

• 3 
3 



2 
2 

2. 
2 
2 
2 
2 
2 
2 
2 




*Itcm polarity reversed for stale, score computation 
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^ High School 



V?\X\Q 

(Ct'do one tn c<tch catogory belOM ) 
Gm<Ji» 5 6 7 8 9 
Ltrmic Group: Black White 
Sox ) Male Female 



10 11 12 
Asian American Americ 



ndian 



Hispanic 



„ Date: 4 ! 




Attitude Toward School 

Directions: Fojlowing is a series of statements. Circle the answer which best shows your feeling 
each statement. Circle only one answer. f.or each statement. 

/ 

Strongly disagree 

^ w Disagree 

/ % Agree 

* Strongly agree 

1 . I enjoy my work at school. 4 

2.. School is usually interesting enough to keep me from 
getting bored. 

3. I find puzzles fun to do. 

- *4. .Teachers talk too much in class. 

, 5. School TkJihorilies hayp t6o much control over me. - 

*6. I would rather be Out working x than remain in school 

7. I don't like gamesthat make me think. 

8. I think this school prepares me to make better decisions ' 

about life's problems 

*9. There is not enough.variety in the way classes are taught. ' 
• 10. Ou£ school building is nice to be in. . K <J^_ 

11. ^ f try to learn" things wherever I am. ' Mf^ ' 

"12. Students in this school are often given the opportunity to 

express their ideas about how the schooj ought to be run. 
■ *13.^ Thdre really isnt much use complaining to the/teachers 

about the school because it is*impossible to influence 
\ them anyway. » . * 

14."SsQet more satisfaction frorn doing an assignment' well than 
froVs^cfciving high marks. , . * 

*15. Too much time is wasted during the school day. , 

*16. There isn't enough variety in the kinds of courses offered by 
this school. 

V 



about 



4 
4 
4 
4 
4 
4 
4 

4 
4 
4 



3 
3 
3 
3 
3 
3 



3 
3 
3 

3 



2 

2 - 

2 
2 
2 
2 
2 

2 
2 



'I/. Teachers assign too much homework. 



'4 
4 

4 
4 



3 
3 

"3 
3 



2 

« 

2 

2 
2 



A*,** rrom mo 1974 r,nr %Y » 9 n a Swdon , 0 ,«^ Pennsylvan.a Dep.r.o,,,,. « Edoc.no*. E^cauonal Oualrty A^mJnt. 
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X 



Strongly disagree 
Disagree 
Agree : 



^18. 

20. 
*21. 
22. 
23 
24. 




29. 
'30. 

*31. 
*32> 
*33. 
*34. 

35. 
*36.. 

*37. 



Strongly fjgree 

I am often bared. ' v 4 

* i ' ' ' 

There is little I can do' about the way this school is run. 4 

I think the eMfreuiTicular activities offered in this school 
are wot thwbile. ' ^ 

My relationships with teac^rs sre very formal and 
impersonal. 

I would, rather learn^new ways 1o do things jjhan keep on 
doing them in the same way. ' ' 4 

The courses available in this school are extremely valuable 
tome. * 4 

v 

I often read and study' in my.courses beyond what is 
required by my teacher. 4 

spend a lot of my free time reading. 4 

ike to talk with my teachers about my ideas. > 4 

upils in this school are given considerable freedom in 
planning their own programs to meet their future needs/ 4 

think-that qiost of what is taught in this school is 
useless in today's world. . - . 4 

Most teachers know what\hey are talking about. 4 

J, would rather tackle a complicated problem than solve a 

* simple one. * . ■ 4 * 4 

Students should have more:* reo twne during the schoo^iay. 4 

Teachers are Cpncerned only' with their own subjects. 4 

f know about everything I need to know to get along in life. 4 

We have loo nri^ny r^uired subjects.. * 4 

Teachers help us whe-n we need them. * 4 

There is too mifch emphasi^ on getting good grades, 
not learning,. '* - 

There are not enough extra-cumcuJar activities offered in 
this school. 



3 
3 



3 

3 

3 
3 
3 



3 

• 3 

3 
3 

* 3 
3 

,3 

■f 



2 
2 



s 

2 
2 



2 
2 

2 
2 
2 
2 
2 



0+ 



1 % 

*Item polarity rev^r<|e}d for scale score computation. 
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Nafne: 1 Data: 

(Circle one in each category below) — • °* 

Grade: 5 6 7 8 9 10 11 12 ^ 
Ethnic Group: Black White Asian American Americarvlndian & Hispanic 
Sex: e Male ' female . . , • 




r 
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Upper Elementary 



MY OPINION 

This survey asks for your opinions about a number of different things. We think 
you Will find this interesting and you will enjoy answering the questions. 
' • . We need your help to make this a good study. It is important that you think about 
each-question and answer it truthfully. If you want to change your answer, please be 
sure to completely erase your first answer. If you object to answering a question just 
leave it bfank. 

The on.ype^e who will see these answers are professional researchers from 
Research for Better<Schools, Inc. No information of any sort about individual students 
will ever be given to anyone by the researchers. This means that your answers will 
never be shown to teachers, parents, police, or anyone else. 



PLEASE DO NOT PUT YOUR NAME ON THIS SURV^. 
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DIRECTIONS: Next to each question check (x) one answer. 



1. DRINKING ALCOHOL (beer, wine, or liquor). 

a. is bad for a kid s health. 

b. makes a kid feel bad. 

c. gets a kid in trouble. 

d. -^makes kids lose their friends. 

e. make^kids-€fo-poor1y in school. 

2. SMOKING CIGARETTES ... 

a. is bad for a kid's health. 

b. makes a kid feel bad. 

c. gets a kid in trouble. 

d. makes kids lose their friends. 

e. makes kids do poorly in school. 

3. SMOKING MARIJUANA (grass, pot, hash) ... 
a. is bad for a kid's health. 

« b. makes a kid feel bad. 

c. gets a kid in trouble. 

d. makes kids lose their friends. 

e. makes kids do poorly in school. 



yes 

yes 

yes 

yes 

yes 



yes 
yes 
yes 
yes 
yes 

yes 
yes . 
yes . 
yes . 
yes . 



no. 

no 

no 

no 

no 

no . 
no . 
no . 



- no - 



no 
* 

no 
no 
no 
no 
no 



not sure _ 
not sure., 
not su ret- 
not sure _ 
not sure _ 

not sure _ 
not sure _ 
not sure _ 
not sure _ 
not sure _ 

not sure _ 
not sure 
not sure 
not sure _ 
not sure __ 
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<}. Havr you ever smoked a cigarette? 

never 

once or twice 

3 lo 10 times * 

11 to 20 times 

21 times or more 

5. Have you smoked cigarettes 
during ttin lust four weeks? 

> neve; 

once or twice 

to ItTtimes 

" 11 to 20 times 

21 times or more 



6. Have you overdrunk alcohol 
(beer, wine, or liquor)? 

never * 

once or ly^ce^ 

3 to 10 tipnes 

11 to 20 times 

21 times or more v 



7. Have you had a drink of beer, wine, or 
liquor during the last four weeks? 



never 



_ once or twice 
_ 3 to 10 times 
_ 11 to 20 times 
_21 times or more 



8. 'Have you ever smoked marijuana? Marijuana 
is ajso calle 6 d grass, pot, and hash. 

never 

once or twice 

3 to 10 times 

11 to 20 times 

21 times or more 



9. Have you smoked any marijuana 
during the last four weeks? - 

> never 

once or twice 



.3 to 10 times 
.11 to 20 times 
.21 times or more 
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f 



Names 



Date: 



(Circle one in each category below) a 

Grade: 5 6 7 8 9 10 11 12 

Ethnic Group:, Black White > Asian American 'American Indian Hispanic 

Sex: Male Female f 



/ 
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Intermediate 
High School 



MY OPINION ON DRUGS AND ALCOHOL • 

This survey asks for your opinions about a number of different things, including 
your attitude toward drugs, and your use of cigarettes, alcohol, and drugs. We think 
you.will find this interesting and you will enjoy answering the questions. 

We need your help to make this' a good study. It is important that you think about 
each question and answer it truthfully. If yodwant to .change your answer, please be 
. sure to completely erase yourfirst answer. If you object to answering a question just 
leaveMt blank, 1 

r The onljrpepple who. will see these answers'are professional researchers from 
Research for Better Schools, Inc. No information of any sort about individual 
students will. ever be given to anyone by the researchers. This means that your 
"answers will never be«shown to 'teachers, parents, police,, or anyone else. 

PLEASE DO NOT PUT YOUR NAME ON THIS SURVEY. 



) 



Items were'adapted from the Drug and Alcohol Survey. Pacific Institute for Research and Evaluation and 
from the Pennsyivania State University Drug Education Ev a ,uation Scaie, Persons, C Use Scat 
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DIRECTIONS: Ciicle one number next to EACH statement. 




f. 

9- 

h 

i. 
j- 

k. 



IHINh that . . 
drinking alcohol (l|eer, wine, liquor) is . 

smoking cigar ottds , , 

* ; 

smoking marijuana (grass, pot, hash) is 

sniffing, inhalants (sniff glue, snappers, 
poppers, gas) is 3 \\ 

faking barbiturates or tranquilizers 
(sleeping pills, downers, barbs, trar\ks, 

' soapers)'is 

9 •• 

taking amphetamines or stimulants (pep 
pHls, uppers, beans," speed, crank) rs . . 

.taking serotonin (wagon wheels, 
bumpers) is" , \] 

.snif^ng cocaine is 

using PCP (angel dust, krystal) is ...w 

V 

Jakifjg-LSD or other psychedelics (acid) 

is t ; 

using heroin or morphine (smack, junk) 
is ... '. 



f\ VPfv n Ivor! 

bad thinQ Hung 


no^ good 
or l),i<) 


a good 


a vory 
good 
thfiK) 


. don't 

kii< <w 


1 „ 2- 


3 


4 


5 


DN 


^ ' ' ? 


3 


4 


5 


DN 




3 , 


4 


5 • . 


DN ' ' 


1 " 2. 


3 ; 


4 


5 


DN 




3" 


* 4 


5 


DN 


1 . • 2 ' 


3 


4 


5 


DN 


1 2 


. 3 




5 


DN 


' I 2 


3 


• 4 > 


5 


DN 


1 2 • 


3 


4 


5 


DN - 


1 2 . 


3, - 


4 


5 


DN ■ , 


12 


• 3 


4 


5 


DN 



A'- .y 
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-DIRECTIONS: , Various substances are listed below. You rnay or may not hav % e used some of these substances, in t^e 
frst two columns, indicate whether or not you have used eac^ substance ANY TIME in you- Re. In the 'ast five 
j colors, shew the number of times you have used each substance in the PAST 3 MONTHS. withouVa doctor's pre- * 
! sp'rton. -Your answers w>!1 remain cortfid3nttel 



i . ' Wsed.some time 

' .in your lifetime 

2* „ How often have you ... 

• YES NO 

a. drunk alcohol (beer. w>ne, liquor)? r Yes No*" 

b. smokefl cigarettes <$Yes No 

c. smoked marijuana (C'ass. pot, hash)? \ Yes No 

• d. sniffed inhrlants (sn:ff glue, snappers, poppers, gas)?* Yes No 

e. taken barbiturates or trar.quilzers (sleeping pills, downers, * * 

. barbs, tranks, soapersj? + Yes* No 

^sj. taken amphetamines or stimulants (pep pills, uppers, beans, 

soeaA c^nk)? • '.....u. ...... ' Yes No. 

g. taken serotonin (wagon wheels, bumpers)? . Yes No 

h. sniffed cocaine? * Yes No 

i. used PCP (angel dust, krystal)? Yes No 

j. taken LSD or othet psyched$!ics (acid)? ..... Yes No 

k. used heroin or morphine (smack, junk)? Yes ' No 

# « 

» ' 



Use in PAST 3 MONTHS 



Si 



None in past -1 or 2 tines ! n 1 r or 2 times 
3 morvths l> past 3 months per mtfnth 



1 or 2 times • 
per wsOa . 



Mce t^an . 
once oer d3v 



A 
A 
A 
A 

A ' 

A. 

A 

A 

A 

A 

A 



8 
8 
B 
8 

B 

8 
B 
B 
B 
8 
B 



. C 
C 
C 

<C 

c 
c 
c 
c 
c 
c 



• * D 4 - 
. D ', 

D 
* D 

<» 0 i 
D 
D 
D 
D 
D 



E 
E 
E 
E 
E 
E 



"> 
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1 . 



Jonbui School District J_ 

* Ooserver . _ 

, . Date \ 



Ieache\ 



Grade Level _ 



1 Subjecte in Classroom 

Numbe? 

Teachers 

- Aides 
Student 
. Other JL 



f)^aw Map 



LIFE SKIL LS'FOR MENTAL HEAL 1H 



Classroom Observation Form 



Time Block 



Subject Area 



_ to 



2. Physical Arrangement 

Number 

- Individual student desks 

Small group tables 

A 



. Resource areas 
. Carrels ' 
.Teacher desks 
Other- • 



\ 



■f . - 



V 
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3. Major Activity Scheduled for 
Observation Period 

'4 

(check one category) 

\ Life Skills Activity • 

Academic instruction 

Tutoring 

1 Recreation/free time— 

Other: z 



4. Mode of Group Participation 
in Major Activity 

' (check all that apply) 

Entire ClaSs 

Small groups' 



— Individual students 
« 

_ Other: : * , 



5. Types Of presentations 



Record the numbfer of minutes the class spends in each of the following categories during the class 
At Jhe end of the period, total the time spent in each category. # /i 



period. 



Minutes per Segment 



Total Time 
on this Activity 



Lecture 

Lectu re/Discussio^ 
Discussion 
Question/Answer 
Drill 



Individualized Activities 
Group Activities 
Vesting/Grading . 
F;ree Time 
Other: 



"6. Nature of Affective Behaviors of Staff (Rate behaviors at end of the observation period.) 

r 

Very High Hion , Some No 
Evidence Evidence Evidence Evidence 



Not 
Applicable 



The teacher tends* to: 

a. support students." 

b, show concord ovor individual student progress. 
*c. frequently criticize or make fun of students. 

^ ck^encourage students to discuss feelings. 

tolerate student behavior thkt causes classroom 
ERjC disruption. , 2 282 



2 
2 
2 
2 




Very High High Some No 
Cvictenco C-'Kience Evidence Cvici*''?' . 



T-i f .develop "we" feeling with students. 

* g. give students the chance to express their feelings. 

*h. discoi/rage, student questions orVecfuests for help, 

i. positively redirect deviant behavior. ' , - 

j t accept student feelings without making value judgments, 

k. be fully aware of student feelings.. 

*• I. be enthusiastic. ' * " * * 

<, . m: * involve students in solving behavior problems, 

n. be oaring 'W^d^radfents 



v 



Narrative on teach behavior 



4 
4 
4 
4 



3 
3 
3 
3 



4 -31 

4 V 3 
4 • 3 

4 3 , 



2 

2 

2. 

2 

2 

2 

2 

2 



■At '.I. ... 

N A 
N/4 
N/A 
N A 
k ! A 
N'A « 
N«/A 
N A*' 



N/A 
k 



*Item^polarity reversed for scale score domputatipn. 



J 



0* 
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* * . ■ • / 

1 ' * • 

Tfcttyature of Affective Behaviors of Students (Rate behaviors at end of, the observation period ) 



e. 



Students tend*to: 

a. agree witk or^upport classmates. 
*b. have difficulty communicating with the teacher. 

c. be caring toward classmates. 
. d. require little supervision. ■ . J 

cooperate ar)d share with classmates. 4 
engage in behavioc-that causes classroom disrupffcm. 
g/ work easily with the teacher. / • 
^ h. be aware of classmates' feelings in discussion situations, 
i. be aware of classmates' feelings orr a personal level. 

- *]. criticize qr maKe fun of classmates. 

I * - 

k. * show pride" in their woFk-aB^ecomeltshment& . 1 

J; % • . • . 

I. takd some responsibility for solving behavior problems. 

m. Jeel free to request help. * 

n. be able to communicate with classmates in discussion 
• j situations. 



Very High fiigh Some No* Not 
Evidence . Evidence Evidence Evidence Aj^jicanio 



4 

4 
4 

4'' 
4 
4 
4 
4 

fc 4 
4 
4 
4 
4 



- t 
* l 



3 
3 
3 
3 

-3 



3 
3 
3 

3 
3 
3 
3 
3 



2 

2 

2 

2 

2 

2 

2- 

2 

2 

2 

2"" 
2 



1- 
1" 



N/A 
•N/A. 
"N/A 

» 

nTa 
. « N/A 

• N/A 
N/A 
N/A 
N/A 

* N/A 
~N7A~ 

N/A 
N/A- 

' N/A 



Narrative om student behavior: 




\ 



*Item polarity reversed for scale score computation. 
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DISRUPTIVE BEHAVIOR SCALE 



To the Teacher:- 



As part of the Life Skills Evaluation Study, we' are \ 
attempting to find out how much students have changed 
over the course of the current school year. One area of 
interest- is disruptive behavior; often a change in the 
degree of disruptive behavior .exhibi ted by a student in- 
dicates a change in the student's attitude toward school 
or toward a particular teacher. This instrument is de- 
Signed to measure some of these changes. 



Di rections: 



Please list \he name of each student in your class. Then 
for each student, rate the chan ge in disruptive behavior 
you^have* observed over the course of the school year 
(5 - Much Less Disruptive,^ ■ Less Disruptive, 3 = 
No Change, 2 = More, Di srupt i ve , 1 = -Much More Disruptive) 



Thank you very much for your participation and continued cooperation. 
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Student Name 



1 . 

2. 

3. 
k. 
5. 
6. 

1: 
8. 
9. 
10. 

n. 

12. 



'3. 1 

14. _ 

15. 



DISRUPTIVE BEHAVIOR SCALE 



■» * 



-16. 
17. 
18. 
19. 
20., 



0 

ERIC 



Much 
Less 
Disruptive 



5 
5 
5 
5 
5 
5 

5, 
5 

5 

5 

5 

5 

5 

.5 ■ 
5 



Change in Disruptive Behavior 
s 



Less * No More 

Disruptive Change Disruptive 



k 
k 

k 
k 
4 

4 

* 4 
4 

' 4 
4 

i» 
4 




5 
5 

5 . 



4 

I 

■ 4 
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3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3- 



3 
3 
3 
3 
3 



2 
2 
2 
2 

J 

2 

2 
2> 
2 

<m^T) 2. 
2 

* 2 

2 
2 
2 
2 



Much 



V 

More 

Disruptive 



2 
2 
2 
2 
2 




1 



APPENDIX C 

_ * 

TEACHER OUTCOME MEASURES 




LIFE SKILL^FOR MENTAL HEALTH ACTIVITY LOG 
LIFE SKILLS FOR MENTAL HEALTH TEAGHER SURVEY 
LIFE SKILLS FOR MENTAL HEALTH OPINION SURVEY 
Life SKILLS FOR MENTAL HEALTH CLASSROOM OBSERVATION FORM 
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Activity Log for Life SkilirTor Mental Health 
Grade Level . Schoo) 



5-8, 9-1), 12-U, 15-18 
* Subject 



O 
I 




^iin:^^:^ - r ^^_; onse that best desc , lb ; s the f;equency — wh!ch you used j eh - - — — 



Listening for Feel ing 
Behavior Feedback 
Values Clarification 
Role Playing 



^Research for Better Schools, Inc. 



Daily , Weekly Monthly 

H^ily Weekly Monthly 

Daily Weekly Monthly 

DaMy Weekly Monthly 
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( s Llht SKILLS HOPS MENTAL HEALTH 

' * TEACHER SURVEY 



Name , : 

- School System ^ 

• Subject Special ty^^Tea 



— Date , ^ 

- Grado Lovel 

No. of Years Teaching Experience 



Directions: This questionnaire is designed to collect feedback on the Life Skills program Since you are 
a participating teacher , it is important to obtain your reactions to the program. Pfease answer each ques- 
tion as honestly and completely as possible. Thank you. 

'1. Which Life Skills Activity Guide do you use? (Circle your ansy/er.) 

A. Ages 5-8 ^ x 

B. Ages 9-11 

C. Ages 12-14 

D. Ages 15-18 ' " 

On the average how often do you use Life Skills activities in your c^room? (Circle your answer.) 



A. Once a cfay or more 

B. Several times a wepk 

C. About onaj a week 

D. Several times a month 

E. Once a month or less 



r 

K 



the Life Skills 



3. Before you attended your first yfe Skills workshop, on the average how often did you use similar 
mental health activities and materials in your classroom? (Circle your answer.) 

A. Once a day or more 

B. Several times a week 
* C. About once a week* 

D. Several times a month 

E. On6e a month or less 

4. Life Skills activities can be employed in a number of ways. Estimate what pertent of h 
activities that you have used fit into each of the following categories. J 

m OSe of Life Skills , Percent of 

Activities Total 

* f Used as separate activities " % 

Integrated with classroom lessons o/ 0 * ■ 

Introduced a teachaWe moments % 

Other , 0/o 

5A * S St f r ^ e9ies t w y e 'Produced in the workshop you attended. Please indicate how ofta you use 
each of these strategies in your classroom by circling the corresponding letter below 

Strategy v 



Once a day 
s or more 

Listening for Feeling A 

Behavior Feedback A* 

Role Playing . A 

Vetoes Clarification A 

ERJC Rcsearch 'or Better Schools, inc. 



Several times 
a week ' 

B 

B 

B 

B 



About onco 
8 week 

C 

c 
c 
c 



Several times 
a month 

D 

D 

D 

' D 
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Once a month 
or less 

E 

E 

E 

E 



(Go on to iho other sido) 



5B Please indicate the usefulness of each of these strategies for your class by circling the corresponding 
letter heolow. 

Strategy • 





Very , 




Somewhat 


Not at 




useful 

VOW 1 V I 




1 1 *** /"% Till 

useiui 


all useful 


Listening for Feeling 


A 


B 


c. 


D 


Behavior Feedback 


A 






D 


Rplc Flaying 




B 


C 


D 


Values Clarification 


A 


B 


C 


' D- 



6. For each behavior described below/circle the letter that best indicates the degree and direction of 
change you have observed in your students with respect to this behavior since you began using the 
Life Skills activities and strategies. ;* 



Behavior 





Very 








. Very 




postive 


Positive 


No 


Negative 


negative 




change 


change 


change 


change*,. . 


change 


Students* ability to 












express ineir leenngs. 


A 


B 


C 


D 


E* 


Students' ability to 












accent their feelings. 


A 


♦ B 


c 


D. 1 


• E 


Students' ability*©. 




f 








accept the feelings of 












others. 


A 


B 

\ 

\ 


c . 


D 


E 


Students' ability to 










accept the values of 










< 


others. 


A 


B 


c 


D 


E 


Student's self- 












confidence and sfelf- 












- awareness, i 


A 


B 


c 


1 

D 


E 


Students'' ability : tb get 
a)ong with one another 

Students* ability to 












A 


B 


. d 


D 


E 












cooperate and relate to . 












you (the teacher). 


A 


B 


c 


D 


E 


Studenls' ability to 












control their behavior- 












and solve problems 












before {hey become 




• - 








major disruptions. 


A 


B 


c 


D ' 


E 



,7. Have you seen any noticeable changes in individual students since you began using the Life Skills 



activities? Please describe. 

/ 

8. Other comments on the Life Skills program. 

C-3- 



LIFE SKILLS FOR MENTAL HEALTH OPINION SURVEY ' * 

Identification:- (enter, last four dlgits'of social securi ty -number) 

Date: » 

Age: under 25 25-3* ^ 35~^5 over kS 

Education: degree Years -experience: ' .* 



Fle,d: , Mental Health Education •__ Other '(spec i fy) 



1 



This survey is deigned to provide valuable feedback to the Life Skills program, 
t should be administered both before the start of the training workshop andagay,.. 
' after. its completion.^ Your cooperation is appreciated. , 

The following statements represent commonly held opinions in the>ields of educa- - 
t.on and mental health. Since these. are only opinions, there are no correct or 

w^ch rr ?n'H t ! r ^ POnSeS , PO f Sib ! e - J° T 6aCh statemen * please check the response 

which indicates most closely the extent to wb-ich you agree or disagree with the 
opinion stated. - - t,,e 

» 

1. Good mental health is desirable but not absolutely essential for maximum- 
classroom learning. 

1 . . 4 ,1 ^ . ' y 

^Strongly Disagree Disagree Somewhat Agree Somewhaf Strongly Agree 
: : * r, ' ' k . 



2. The teaching of values has no place in the cl 



as.s 



*oom. ' 



Strongly Dil^ree Disagree Somewhat . Agree Somewhat Strongly Agree 



3- Basic Sk.-lls need more emphas.is than, Life Skills in the school today. 

" t . 

1 2 . 3 * i, * 

Strongly Disagree Disagree Somewhat Agree Somewhat Strongly Agree 



h. Affective educat ionJLs not related to Basic Skills. 

' 1 2 v 3 . k 

Strongly Disagree Disagree Somewhat _Agree Somewhat Strongly Agree' 



5. Students should be taught to share and publicly affirm their val 



ues . 



1 2 . { k 

Strongly Dfsagree .Disagree Somewhat ' Agree Somewhat Strongly Agree. 
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6. Unless knowledge is related to an affectfVe state in the learner, the like- 
lihood that it will infVuence beh/nor is limited. ' 

~ \\ p * 2 ' . 3 li / * 

• Strongly pisagree'. Disagree Somewhat Agree Somewhat ''Strongly Agree 1 

- ■ ; r ' — » — • 

7. Children are generally unaware of the effects tfieir unacceptable or disrup- * 
tive behavior has on others around* them". f 

1 ' / v * 3 * k 

, Strongly Disagree Di sagree* Somewhat Agree Somewhat Strongly' Agree 



i 

* * w 



8. Telling a student! how he/she should behavk takes away the opportunity for the 
student to .learn +iow his/henbehavior affects others. 



• 2 
Strongly Disagree Disagree Somewhat A 



3 k 
ree Somewhat Strongly Agree 



9. Jt is wrong to'teach children to -accept personal characteristics whi^ can- 
not be changed^ 

c ■ i / 2 - 3 ' ■ 

Strongly D/sagree Disagree Somewhat Agree Somewhat Strongly Agree 



10. The way knowledge affects one's behavior occurs only in the degree to" which 
the individual has discovered its personal meaning for himself or nerself. 

Strongly, Disagree Disagree Somewhat Agree Somewhat Strongly Agree 

g 



r. 



v 



11. Whenever we solve,' or attempt to' soj've, a .problem for a student we take a 
learn.ing opportunity away from the student., 

I ' • 2 • 3 ' " i, 

Strongly Disagree • Disagree Somewhat Agree Somewhat Strongly Agreed 



12. It is extremely difficult to effectively' integrate* cogni tive and affective 
education within the same curriculum activities. 

. c 1 2 " 3 ' * 

J Strongly Disagree Disagree Somewhat Agree Somewhat. Strongly Agree 



\ 



• * / . 

.13. Children in school should be expcJsed only to t.hose values which are commonly 
held by ot/r own society. , ■•, 

1 '2 .3. ■ k 

Strongly Disagree Disagree Somewhat Agnee Somewhat Strongly Agree 



/ THANK YOU FOR YOUR PARTICIPATION 
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LIFE SKILLS FOR MENTAL HEALTft 
Classroom pbservation Form 



School/School District 

Observer ' ' 

i Date ! ; 



Teacher 



Grade Level 



Time Block 



^Subject Area 



to 



1. Subjects in Classroom 
Number f 

4 

. *Teach§rs 

4 

— — Aicjes • 
— , — Students 
- Other: ' 



Draw Map: 



S 



2. Physical Arrangement 
Number 

Individual student desks 

— Small group tables' 

— Resource areas 



.Carrels 
.Teacher desks 
. Other: L__ 
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3. Major Activity Scheduled for „ 4. Mode of Group Participation '. 

Observation Period . "in Major Activity 



(check one category) t (check all that apply) 



Life Skills Activity * ^ Entire Class 

Academic instruction ' ^ Small groups ^ 

Tutoring ^ ^ Individual students 

Recreation/free time 1 m Other: 

Other: ' 



5. Types of presentations . 

Record the number of minutes the class spends in each of the following categories during the class period. 
At the end of the period; total thetime spent in each categor^- , * 



Total Jime 

Minutes per Segmeat * on this Activity 



Lecture 

Lecture/Discussion 
Discussion 
Question/Answer/ 
. Drill 

Individualized Activities 
Group Activities 
Testing/Grading 
Free Time 

Other: ^ '.' x 



0 



6. Nature of Affective Behaviors of Staff (Rate behaviors at end of the observation period.) 

• - Very High High * * Some No Not 

1 * Evidence Evidence Evidence Evidence Applicable 

The teacher tends to:* w 

a. - support students. , / ' 4 3 2 1 N/A 

b. show concern ovoi individual student progress. • . 4 3 • 2 ' 1 N/A 
*c. frequently criticize or make fun'of students. . i ' 4 3 2 1 N/A 



d. encourage students to discuss feelings. ^ 4 3 2 1 



N/A 



*e. tolerate student befiavior that causes classroom 



0 "disruption. 4 3 2 1 N/A 

ERIC * c-7 295 • 



f. develop ••we" fec.ling with students. 

g. give students (he chance to ; e*press their feelings. 
*b. ;discourag& student questions or requests for help. 

i. positively redirect deviant behavior, 

'j. accept student feelings without making value judgments. 

• k. be fully aware of student feelings. 

I. be enthusiastic. 

_m. involve students in solving behavior problems, 

n. be caring toward students. * * 

r 

Narrative on teach behavior: 

* ■ ■ " . 



>Item polarity .reversed focr scale score computation. 
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7 Nature of Aftective Behaviors of Students (Rate behaviors at end of the observation .period.) V ' 







Very High 
Evidence 


' High 
Evidence 


Some 


No Not r 


Students tend to: 












aaree with or suDDort classmates 


4 


3 


2 

Cm 


1 M/A 

1 IN/A 


*b. 


have difficultv comfnunicatino with thr tpprhpr 

» • v« w v< V" nil w xm t \ j \S \j MIDI III UUM VI Willi VI Iv I C C* v 1 1 C 1 . 


4 • 


3 


2 

Cm 


1 M/A / 
1 IN/A ' 


c. 


be carina toward classmates v 


4 • 


3 


2 

Cm 


1 M/A 
I IN/ A # 


d. 


reouire little sunprvisinn • 0 


4 


3 




1 M/A 
I IN/ A 


e. 


cooperate and share with classmates. 


4 


3 • 


2 


1 M/A 
I IN/ A 


*f. 


engage' in behavior thfat causes classroom disruption. 


< 

4 


' 3 


0 
c 


1 M/A 
I IN/A 


g- 


work easily with the teacher- 


4 


3 


2 


1' ' N/A 


h. 


be aware of classmates* feelings in discussion situations.' 


. 4 

• 


3 


. .2 


1 N/A 


1. 


be aware of classmates' feelings on a personal level. 


. 4 


3 


, 2 


• 1 N/A 


*j. 


criticize cr make fun of classmates. 


4 


3 


2 


1* N/A 


k. 


show pride in their work and accomplishments. 


4 


3 


2 


1 N/A . 


1. 


take some responsibility for solving behavior problems. 


4 


. 3 


2 


. 1 ' N/A • 


m. 


feel free to request help. * 


4 ' 


• 3 


2 


jf • N/A ' 


• n. 


be able to communicate with classmates in discussion 
situations. — 


4 


■ 3 


2 


1 N/A 



Narrative on student beha\lior: 



*Item polarity reversed for scale score 



computlftioi}. 
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Characteristics 



ABSTBACl 

Because student ratings of L their instructors 'are 
frequently used by colleges in making personnel "decisicrs and because 
a variety of course, student, and instructor characteristics may be " 
significantly related to these ratings, academic departients should 
investigate their -student evaluation .process! Besponses on 1292 
student evaluation of instruction questionnaires, collected in 81 
university psychology classes were analyzed. Factor analysis of the 
evaluation items yielded two factors which ^iere named "instructor 
evaluation" and "student motivation," Multiple regression analysis 
identified -several instructor, student, and course characteristics 
which were significant predictors of these factor score's shen the 
effects -of other .characteristics were held constant, ihe variables * 
"expected grade in course," "instructor age," and "instructor status 
as full-time^ or part-time faculty member" had a small, tut 
significant*, effect. on both "instructor evaluation"- and "student 
motivation;," students tended to ratae their instructors and their own ' 
motivation more positively when thef expected higher grades, had ' 
younger instructors 1 , and had full-time faculty instructors. Two 
variables, «course levfcl" and "status of course in student's degree 
program^" had a [ small, Obut significant, effect only on "student 
motivation," The results suggest that the seven different 
instructor-evaluation items seem largely to be tapping a single 
evaluative dimension* (Author/HBB) 
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Paper presented at the Annual Convention of the American Psychological 
Association, Los Angeles, CA, August 1981. , ' 



STUDENT EVALUATIONS O'F PSYCHOLOGY INSTRUCTORS 

^he mode of faculty evaluation in which students rate their- i nstructors 
on anonyqgus questionnaires is widely used in American col leges and uni/er- 
litfes ( Chronicle of.Higter' Education , 1979),- Because these student ratings 
*re frequently used in making personnel decisions, and because*it is known 
• . that a variety of*x:ourse characteristics, student characteristics, and 

instructor characteristics are significantly related to student ratings in 
some circumstances (Centra, 1978; McKeachie, 1 979 ; • Schul tz , 1978),. it' seems 
advisable for academic departments "to investigate the student evaluation 
process, as it occurs within the particular circumstances' of their institu- 
tions and disciplines- This is a. report, of the method's and findings of such 
an investigation within the Department of P^chology at Humboldt State Uniyer- 
sity. - ' *' • 

• r ' • „ 

Procedure / • ; 

' Responses on 1292 student evaluation questionnaires collected by. depart- 

mental secretarial staff in 81 Psychology classes during 1979 were analyzed. * 

Sets of evaluations* were obtained for 48 different course numbers - five 

different lower division courses, 26 diTfejreiit upper division courses, arrd 

<\ 17 different graduate (M.A. level) cc?urses\ These evaluations applied ^o 

27 different instructors, ranging irl rank, from part-time lecturers to tenured 

fiull professors. The student evaluation process was mandatory for part-time 

fatuity, nop-tenured faculty, and associate .'professors intending to apply for 

promotion. . . , 

* SI'-. 

^ - The student questionnaire consisted of "seven -instructor-eval uatitfrf^T^ris, 

' two self-evaluation \ifefems, aad two course-evaluation items. Each of thes # e 
items was rated on a five-point scaje. In addition, the questionnaire included 
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seven items regarding student characteristics. 

Resul ts • — ^ 

In* this set of eval uation questionnaires, the general response of stu- 
dents to their instructors was very favorable. The mean ratings on all seven 
instructor evaluation items were between 2.0 and 1.5, where 1 was the highest 
rating > possible. The mean ratings on sel-f-evaluation items and course- 
evaluation items were somewhat lower -- between 3.0 and 2.0. 

. Responses on the eleven evaluation items were factor Analyzed by the 
method of principal factoring with iteration, using a/6rimax rotation.. A 
two-f^tor solution produced the closest approximation to simple structure. 

Table 1 shows that all seven of the instructor-evaluation items had 
loadings over .60 on Factor I, with the "overall teaching effectiveness" 
item having the highest lpading. .This factor was named "instructor evaluation 

Table 2 presents factor loadings for the four items which loaded o'n 
Factor II. A course-evaluation item which asked students to rate their 
"expectation that course material will be useful" had the highest loading. 
Two self-evaluation items ("original interest in subjects and "cl ass parti- 
cipation"), as welT as one instructor-evaluation item ("ability to stimulate/' 
interest") loaded at lower levels on Factor IK Th.is factor was-named, "stu/ 
dent mptivation." . I 

if 

A set of factor scores was generated for each factor by simple averting 

// 

of the relevant item scores on each questionnaire. Thus, an "instructor 

• K '■ ''' 

evaluation- factor scorj and a "student motivation" factor score were com- 
puted .for each questionnaire. ' • 
Multiple regression analysis was used to identify the instructor, ^twdent, 
and cour se cha racteristics which were significant predictors of "instructor 
evaluation" and "student motivation." Tables 3 and 4 show the following 



variables which were regressed on Factor I scores and on Factor II '.scores: 
instructor sex, instructor age, instructor rank, student year in school, 
student major, student^ student'sex, student grade-point-average, ex-,, 
pected grade in class, course level,', and status of course in student's 
degree program. The correlations with the factor scores, the beta coefficients, 
F-ratios, and significance levels are presented for each of these variables. 
Both regressions resulted in Multiple R values which were statist!- *" 
. cally/significant, but small. The best -combination of predictors coul d 
account for only 13% of the variance in "instructor evaluation 1 ' 1 scores and 
for only 12% of the variance in "student motivation" scores. 

Standardized regression coefficients and mean scores for various cate- 
gories of questionnaires were inspected in order to explicate the relation- 
ship of specific instructor, student^ and course variables to Factor I and 
Factor II scores.". \ - 

Three variables had a small, but significant,' effect on 'both. "instructor 
„ evaluation" and "student motivation," when the effects of other variables 
; were- held constant. .These were 1) expected grade in class, 2) instructor 
^J, and 3) instructor status as full-time or part-time faculty member. 
. Students tended to rate their instructors and their own motivation more - 

positively when they expected higher grades, had younger instructors, and 

had instructors who were full-time faculty. 

Two variables had a' small, but significant, effect on "student motiva- 

tion" only, when tfce effects, of other variables were held constant. These 

were 1) course level and 2) status of course' in student's degree program. 

Students ii^ graduate courses had higher motivation scores than students in 

upper division courses, who in turn had higher scores than students in lower 
.... ' - \ 

div 1S1 on courses. For students in lower division courses only, those taking 



courses which did not apply to requirements in their, majors h^d higher moti- 
vation scores than those taking courses' which did apply to major Requirements 

Discussion & ^ 

Within this set of 1292 questionnaires, the seyen .different instructor- 
, evaluation items seem largely to be tapping a single evaluative dimension. 
The item which asks students to rate their instructors' "overall teaching 
effectiveness" is probably the best single measure of this dimension. 

The value of extraneous student and course characteristics in predicting 

instructor evaluation ratings is reassuringly-low. It does not seem that * 

teaching a particular category of student or type of course gives instructors 

a significant edge in instructor-evaluation ratings (aUhough two course 

variables were significantly related to student motivation ratings).- * 

- ^^It is possible that instructors -of classes where many students expect 

high grades (due to high student achievement, .instructor leniency, or other * 

factors) have a ^^' 11 advantage in the student evaluation process. Other 

investigators have also found significant relationships between expected 

grade and'student ratings of instruction (Stumpf and Freedman, 1979; $asta 

and Sarmiento, 1979). Perhaps class grade distributions should be Included 

with student evaluation questionnaires when the latter are considered in 

personnel reviews, ^ v • 

* ♦ 

Two instructor characteristics -- age and full-time vs. part-time 

» 

status had small, but significant, relationships *to< instructor evaluation. 

scores. These relationships are interesting to ponder and may deserve fur- 

i 

ther investigation. Centra (1978) reports that college. teachers with le§s 
than three years or more than 12 years of experience tend to receive lower %t 

student ratings- than teachers in the middle range of experience. Some older 

1 * 



instructors may become stole and out of touch with contemporary .student needs 
Part-time instructors may be. relatively inexperienced and/or suffer from pro- 
fessional isolation/ Perhaps departments should recognize the potential 
problems of both groups and^attempt to provide meaningful support. 
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Table 1 

1 Factor I: Instructor. Eval uation 



, Items 
Knowledge of subject 
Clarity of presentation 
Openness » * 

Overall teaching effectiveness 
Preparation and organization 
Clarity pf assignipents and grading 
Ability to stimulate interest ^ 



Factor Loadings 
.7-34 . . 
.837 
.641 
.863 
.738 

.608' " 
.624 



Table 2 

Factor II: Student Motivation 



Items 

Your .original interest in subject 

Your level of class, participation 

Your, expectation "that course material 
will be usefal 

Instructor's ability to~stimulate interest 



Factor Loadings 
.532 
.416 

.735 
.497 
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Table 3 



-> 





T 

Mul.Wple 

Variable 


Regression on 
r 


Factor I Scores 
Beta F 


P less than 




Instructor sex 


.18. 


.05 


1 i - 

U9 


.163 




s * Instructor age 


.11 


.20 


25.7 


.001 •* 




•Instructor rank 


-.16 


-.23 


39.2 


.001 * . 




Student year in school' x 


' -.15 


.01 


0.1 


' '.753 




Student major 


-.15 


-.05 


1.9 


M63 




Student age . * 


e 

>. -.16 


' - .08 


3.8 


. .852 




CfuHorvt" 'coy 


• 

.10 


' .05 


3.5 


.060 




Student GPA 


- . T3 


-.00 

* 


0.0-' 


.911 




Expected grade 


-.23 


-.19 


3.4.0 


.001 * 




Course level 


-.05 


_* 

M 


' T.3 


.256 




Status of course in 
•degree program 


-.12 


.01 , 


\o.6 


.817 *' 




* 


= .13 * 


p < .001 

s 

% 
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Table 4 

K 

Multiple Regression on Factor II Scores 



Variable . * 


r 


Beta * - 


F 


p'le'ss than 


Instructor sex. 


.10 


is 

.04 . 


1.6 


.212 ' 


Instructor age 


.04 


.10 


6.0 


.015 * 


Instructor rank 

» 


-.10. 


. -.12 


9.7 


.002 * 


Student yec>r in school 


-.15 


.04 


0.8 


. ^69 




-.10 


-.02 


0.2. 


.644 


Student age 


-.16 


-.07 


'3.4 


.064 


sikident sex 


.02 


-.01 


0.1 . 


744 


Student GPA 
Expected grade 
Course level 


•>* 
-.19 

-.29 

-.13 


-!04 • 

-'.25' 

-.10. 


1.2* 

m 

59.3 
6.7. 


)272 
.001 * 
.010 * 


Status of course in 
i aegree program 


-.03 


» .09' 


6.5^ • 


. .011 * 


- R = .34^ R 2 = 


.12 


p < .001 




— 1 


# 


* 

• 


r 


i 
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